I'm 19, and only had a stache and some chin growth so far.

I decided to regrow my beard 3 weeks ago.
In this last week I suddenly noticed vellus (and some terminal hairs) in the sideburn area. There was nothing there before.

It can start filling in, and fast, at any given time. Especially when you're in your teens.
I hope that eases your mind a bit!