Technically, he did hit a ball, just not the golf ball