The guy's probably insecure because he can't grow a beard so he's taking it out on you.