i would say no as long as you get rest and healthy diet. people say you need to sleep a certain time i doubt that is a problem rather then not sleeping a good amount of time.

i used to work at night at a warehouse bakery from 4pm-4am never had any problems growing facial hair.