As a stunt man working with the 3 Stooges he was used as a stand-in for Shemp Howard after Shemp's death and before Joe Besser joined the stooges. Reportedly Palma was filmed from the back & old footage of Shemp was inserted for frontal shots.
Before moving to Hollywood in the 1930s he worked as a mortician in the Provenzano funeral home, owned by his parents on 2nd Avenue in Manhattan, NYC.
He was born in NYC.
Joe's last years in the business were as an assistant to Jack Lemmon. He received small credied roles in Mr. Lemmon's movies during the 1960s just before Joe retired.
Real last name was Provenzano.