Do the hairs falling out have a root on them? If so that't not the hairs breaking and just natural shedding. If the hair's don't have a root then they have broken off. I've never had this problem myself, do you happen to apply any oil to your beard at all? I think that is what is keeping mine healthy.