Joseph F. Philp was born around 1843 in England to Joseph and Ellen Philp. His father worked as a surveyor. The family immigrated to America around 1844 and settled in West Troy, New York. They moved to Tyrone, New York, in the 1850s, and by 1860, the family owned $125 of real estate and $175 of personal property.
He enlisted in the Union army on August 11, 1862, and he mustered in as a private in Company B of the 161st New York Infantry on September 9. The regiment took part in the siege of Port Hudson, the Second Battle of Sabine Pass, the Red River campaign, and the Mobile campaign. He was promoted to corporal on August 13, 1864, and he mustered out on September 20, 1865.
Philp returned to New York after the war, and he married Sophronia Knapp there around 1867. They had at least four children: Charles, born around 1869; Frank, born around 1870; Ella, born around 1873; and William, born around 1875. They lived in Tyrone, and Philp worked as a farmer. He applied for a federal pension in November 1890 and eventually secured one. He died in New York on June 9, 1920.