Joseph F. Gaston was born around 1843 in Ohio to William and Sarah Gaston. His father was a farmer who owned $5,000 of real estate and $1,000 of personal property by 1860. The family lived in Morefield, Ohio, until the early 1850s, when they moved to Wingville, Wisconsin. By 1860, Gaston was working as a farmer.
He enlisted in the Union army on July 21, 1862, and he mustered in as a corporal in Company F of the 20th Wisconsin Infantry later that day. He fell ill soon afterwards, and in September 1862, he informed his family that he was “not very well just now.” He died of disease in Rolla, Missouri, on November 15, 1862.