Joseph F. Haskell was born on July 26, 1842, in Harvard, Massachusetts, to Adolphus and Elizabeth Haskell. His father was a farmer who owned $2,500 of real estate and $300 of personal property by 1860. He grew up and attended school in Harvard, and by 1860, he was working as a laborer.
He enlisted in the Union army on August 13, 1862, and he mustered in as a private in Company G of the 36th Massachusetts Infantry on August 27. The regiment took part in the Battle of Fredericksburg, the siege of Vicksburg, the Knoxville campaign, and the Battle of the Wilderness. He was wounded at Knoxville on November 29, 1863, but he eventually recovered and rejoined the regiment. He was wounded again in the knee at the Wilderness, and he died in Washington, D.C., on June 10, 1864.