Was I wrong?

So I have this friend who called me a while ago. Every time he calls me, he always says stuff like you're lame, you're boring, or you're a hater for no reason. We always have a good conversation but I hate it when he makes such comments. I got tired of it and I told him that he needs to grow up. We're both 22 and he will be turning 23 soon. As soon as I told him he was immature, he said that I was judging him and that I'm a judgmental person. After 5 min he said he had to go. I even asked him if he felt offended and he said no but I think he lied. I explained myself for why I feel he's immature but he defended himself by saying he was only joking.. I don't mind jokes but isn't there a limit to everything? Seems like everytime he has something to say about me.Honestly I think he's serious when he makes such comments.Am I wrong or is he immature? If I'm wrong for feeling this way then why does he always make such negative comments?