My boss yesterday told me I think you have to shave. He didn't tell anybody else that just me. Other workers have beards some even bigger ?

Do you really like your beard? Why not shave off the beard? it is more hygienic to keep your chin smooth. I think it is a matter of sanitary. The beard can cause facial dermatosis. Sometimes food gets stuck in a beard. Ew.

Tell him that it's against your religion. He can't touch you then and he has to let you keep your job. If he tells you that he didn't think you were religious tell him it's because your family didn't allow you to tell anyone.

He's sexually attracted to you

You may be look like a terrorist. (Are you happened to a Muslim btw ?)

Are you certain he was referring to your face....??

maybe you look better without one ;)