John Swanson was born on March 24, 1802, in Pittsylvania County, Virginia. He married Julia B. Cook in Halifax County, Virginia, on January 21, 1824, and they had at least eight children: John, born around 1829; Jarrett, born around 1831; Julia, born around 1833; Frances, born around 1836; Samuel, born around 1838; James, born around 1840; Elizabeth, born around 1842; and Mary, born around 1843. They lived in Pittsylvania County, and Swanson worked as a tobacconist. By 1850, he owned $1,200 of real estate. A decade later, he owned $3,500 of real estate and $160 of personal property. He supported the Confederacy during the Civil War. His wife died sometime in the 1860s, and he passed away in Pittsylvania County on June 26, 1882.