James M. Dees was born around 1855 in Mississippi to Thomas and Delia Ann Dees. His father was a farmer who owned $50 of real estate. He grew up in Neshoba County, Mississippi, and his father died in the early 1860s. By 1870, he was working as a farm laborer. He died sometime after 1882.