Not sure about relationship of 4 years - stay or go?

Have serious doubts about whether my boyfriend of 4 years is the person I'm supposed to spend my life with. Reasons being:

1) he lacks respect to his mum and doesn't want to fix relationship with her

2) he gets easily offended, yet expects others to not be offended when he is a dick to them

3) fear of ending up in a sexless relationship since he has shown no interest in sex and is overly proud of being a virgin at 28, but is not religious.

4) seems to hate girliness and is more into hoodies than dresses. Which while not completely bad, I would like it if he appreciated it if I make an effort to look good.

5) he thinks he is never wrong

6) my friends and family are not too crazy about him

7)I feel like my spirit has been broken since I been with him.

8) I feel bad nervous when I'm around him, like I'm gonna screw something up rather than good nervous

All in all he treats me well but these are bugging me and making me have serious doubts as to wherther to stay or let go.