Joseph was born in Buffalo, New York on the 18th of June, 1870 and when he was 26 years old, he enlisted in the US Marine Corps out of Boston, Massachusetts. When he deployed to near Cuba in support of the Spanish-American War, he was a Private and it was his actions during an operation to cut off a communications cable that would earn him the Medal of Honor. The citation reads:

On board the U.S.S. Nashville during the operation of cutting the cable leading from Cienfuegos, Cuba, 11 May 1898. Facing the heavy fire of the enemy, Franklin set an example of extraordinary bravery and coolness throughout this action.

Joseph received the Medal of Honor on the 7th of July, 1899 and remained in the Marines. He reached the rank of Sergeant Major and retired in August of 1929 after thirty-three years of service. Joseph John Franklin died on the 28th of April, 1940 at the age of 69 and he is buried with his wife Daisy in the Cypress Hills Cemetery in Brooklyn, New York: Laurel Green Section, Block 1, Grave 312.