I have your exact problem.

Mine is the same sort of colour and just as curly/frizzy. I have had issues at work where people have passed comments but to be honest, I just had to get over it.

No point in growing a beard if you aren't man enough to wear it