James F. Stepter was born around 1833 in New Castle, Delaware. He married Amanda Kershaw on September 7, 1854, and they had at least three children: William, born on June 28, 1857; Mary, born on June 5, 1859; and Lewis, born on October 10, 1861. They lived in Cecil County, Maryland, and he worked as a weaver.
He remained loyal to the Union during the Civil War. When a brother sided with the Confederacy, he declared that he “never will own him for a Brother any more.” He enlisted in the Union army on August 11, 1862, and he mustered in as a private in Company B of the 6th Maryland Infantry. According to his service records, he was 5 feet, 9 inches tall, with black hair and black eyes. The regiment took part in the Overland Campaign, and he was wounded in the Battle of the Wilderness on May 5, 1864. Confederates captured him soon afterward and imprisoned him at Andersonville Prison. He died there on October 30, 1864.