Wahoo: Just outlast them. I've been bearded for so long people wouldn't know me shaved (except for that one terrible incident chronicled in "Bad Dream.")

Eventually the beard is just part of your visual identity, and the compliments overtake the criticisms. Tell 'em that change happens. Embrace it. Enjoy it. Or at least just get over it.