Did I Consent?

So this has been going through my head a lot recently, and I just need clarity so I can move past it.   I had gone down to visit my crush and he decided to stay at the Air BnB I was staying at overnight.  He wanted me to cuddle him which I did and then he started kissing me in which I reciporicated and then it became a make out session.

Further on he started rubbing my genitals through my underwear which I thought was going a bit far but it felt nice so I allowed him to keep doing it.  He then started putting his fingers inside my underwear.  In which I pushed him away.  He ended up asking me, "why not?" Now I didn't want him to get angry or leave me so I made an excuse I told him I was on my period and I felt dirty.  In which he responds with. "Guys don't care about that sort of thing." And he continued to touch me down there. He also ended up taking my underwear off after saying that he wouldn't and he started to finger me in which there was so many emotions going through my head I didn't know what to do.

He also asked me if I would have sex with him but I shot it down twice because the first time of, "I'm not on birth control at the moment and I don't want to accidentally get pregnant." Was not a good enough of an excuse for him for me not to have sex with him.  Luckily for me he listened even though I could tell he was upset about my answer.

So did I give him a consent like he said I did?.. I talked to him about it and he said if I had said no he would  have stopped.