Am I too sensitive? ?

My boyfriend confuses me in the way he talks. Sometimes he responds to a question or statement and just sounds aggressive and patronising in his tone... but he says he’s not angry. He will often point out things I say or do that are “stupid” or “annoying” it seriously makes my blood boil sometimes when he puts so much emphasis on the word “stupid”. I’ve told him it upsets me and he just says that he says it but he doesn’t mean I’m stupid or annoying. Over time I’ve started feeling self conscious around him, I feel like my self esteem us getting slowly destroyed. 

Im 28 years old, am I too sensitive? I’ve thought about breaking up with him many times, but then I wonder if I need to toughen up. At my age I feel like I should be able to disregard these things and not let it do this to me