Was I in the wrong?

A couple days ago, I had lunch with my ex since it was his b-day. We picked up lunch and he took me to the apartment ,where him and his gf are staying. We went inside and he starts hugging me for the longest time til we wound up kissing and him touching me. Next he back away cuz he must of gotten excited and it was like he couldn't breathe cuz he had his hand over his heart and his hands had no feeling. I was scared. We were both each other's firsts and we both seem to have the strong connection that we can't seem to let go. But my ex told me that when he broke up with me it's not cuz he stopped loving me. But he's with this other girl, whom I found out from him that she has chrohns disease. Idk what to do?