Edward Simon Hughes was born around 1823 in New York to John Hughes. His father was a farmer who owned $2,610 of real estate by 1850. He grew up in Trenton, New York, and by 1850, he was also working as a farmer. In 1856, he received an appointment as a postmaster, and he became a justice of the peace in the 1860s. He never married, and he died sometime after 1880.