Edward Patterson was born around 1838 in Albemarle County, Virginia. He lived in Richmond prior to the war and may have been owned by Tucker Cole. Patterson described himself as a mason in his enlistment records, but he later testified that he worked in a tobacco factory.
Patterson enlisted as a private at the age of 26 on June 28, 1864, in Woodstock, Vermont, and mustered in on July 20 in Philadelphia, Pennsylvania. His service record describes him as 5 foot 3 inches with black hair, black eyes, and a black complexion. He served in Company E of the 45th USCT Infantry Regiment. The army promoted him to corporal on July 20, 1864, and to sergeant on August 1, 1864. Patterson served throughout Virginia. He took part in the Battle of Fair Oaks on October 27 and 28, 1864, participated in the Siege of Petersburg, and witnessed the surrender of the Confederacy's Army of Northern Virginia on April 9, 1865. Patterson mustered out of the army on Novmber 4, 1866, in Brownsville, Texas.
Following the war, Patterson lived first in Washington, D.C., and later in Pittsburgh, Pennsylvania. He married Eliza Patterson, who died in Washington, D.C. Patterson married Charlotte (Lotti) Johnson on July 29, 1891, in Washington. They had no children together. Patterson applied for a pension in 1890 for rheumatism, heart trouble, and general debility. The government, however, rejected his application, insisting that his conditions failed to meet the pension requirements. Patterson died in Pittsburgh on February 11, 1902, from unknown causes. His widow Charlotte never filed for a pension.