Susan Baker (maiden name: Richardson) was born around 1830 in Kittery, Maine, to Reuben and Mary Richardson. Her father was a mechanic who owned $200 of personal property in 1860. The family moved to Lowell, Massachusetts, sometime in the 1830s and then to Manchester, New Hampshire, in the 1840s. She married Andrew N. Baker in Lawrence, Massachusetts, on December 24, 1851, and they had at least five children: Annie, born around 1852; Walter, born around 1854; Cora, born around 1858; Maude, born around 1862; and Grace, born around 1866.
They lived in Manchester, and her husband worked as a clerk and paymaster. By 1860, they owned $2,000 of personal property, and they employed at least one white domestic servant. A decade later, they owned $4,000 of real estate and $1,000 of personal property. She remained in Manchester for the rest of her life, and she died there on July 17, 1888.