I don't exactly know what their saying but it sounds like Joseph predicted what Gintoki was gonna say (possibly something about having a similar voice) and it seemed to have pissed Gin off.