Was I right to leave him? ?

I work hard and managed to buy an apartment after years of saving which I made look nice, but remain humble in my attitude towards life. I started dating a guy who lived in a different neighbourhood renting an apartment which is in a bad state. I never judged when visiting him. Thing is - he kept dropping comments like 'I don't like your area' even though its a really beautiful and safe neighbourhood where people aspire to live. He also said I look my age / a little older, even though everyone else says I look much younger (I eat healthy and exercise daily). He then said I'm gonna come to your apartment and chill..I'm sure you'll be cool if I make a mess there. I felt he was putting me down in subtle ways and also said 'my ex earned more money than you!', so I politely ended it. Why would he have done this? He could have been happy dating a girl who has her act together and who is responsible...