Benjamin Haden Anthony was born on July 16, 1836, in Campbell County, Virginia, to Charles Anthony and Martha Haden. His father was a planter who owned $71,000 of real estate and $60,000 of personal property, including nearly 100 enslaved laborers. Anthony grew up and attended school in Campbell County. He married Jane M. Brandon on February 9, 1857, and they had at least eight children: Charles, born around 1857; Victor, born around 1859; Benjamin, born around 1863; Martha, born around 1865; Ella, born around 1866; John, born around 1868; Paul, born around 1870; and Munroe, born around 1873.
Anthony enlisted in the Confederate army, and he served in both the 2nd Virginia Cavalry and the 11th Virginia Infantry. He mustered out on October 20, 1862, after furnishing a substitute. He swore an oath of allegiance to the federal government on May 30, 1865. Anthony worked as a farmer in Campbell County after the war, and by 1870, he owned $4,000 of real estate and $1,500 of personal property. He died there on January 25, 1910.