I would not buy what other salespeople say about my beard (I don't normally deal with other salespeople as peers...). Never go to salespeople for advice!

Being in the investment business all of my life I thought that I HAD to be clean shaven. Several years ago I wore a circle beard and, looking back on it, probably picked up more clients (it made me look a little older than I am). Today, fully bearded (and for the first time in my life), I still don't see any negativity between me and the client that would ultimately effect our relationship. Some of my old clients that never saw me bearded have questions (mainly the women) but the vast majority have nothing to say. If anything it's a great icebreaker.  I try to keep it light hearted and it works out. 

For me, being bearded gives me quite a bit more self-confidence (I've always been a cocky !$*! though, just a manly man cocky !$*! now). I do not like the way I look clean shaven any more and either does my wife! I do notice more respect from men from the start. Some women outwardly dislike it to the point of immediate comments. However, that said, it's my expertise and personality that they are buying. If my beard is THE deal killer for them then we never were a good match from the start (and I don't want them as clients anyway). 

That said, if YOU feel that you are suffering in your professional life then you should consider a change. If your income and sales are the same (or better), then you already have your answer.