Am i mean for feeling this way?

I'm bi sexual and a male. I have my first experience with a guy at age 18 (im 21 now) he was 2 years younger than i was but he litterally figgured me out and forced it out of me. I kinda fell in love with him. We dated for 3 months but we both were in the closet. We had sex 1 time while we were dating. Then he wanted to come out to the whole school and i told him i wasn't ready. I told him that he was the only person to know and the only reason he knew was because he threw himself at me so hard that i decided to hear him out. When i told him that i wasn't ready he threaten to out me. He tried to blackmail me into coming out with him. I lost trust in him and ended it. I graduated high and kinda reconnected with him a year later. We hung out at the mall and i took him home. When we got there he invited me in. He then tried to have sex with me and i said no. He kept saying you know you want to. And i was like i really don't. He gave me this sad sob story about him not being able to meet anyone after me and all this BS. i felt sorry for him so i had sex with him. Then he went and told his friend which i asked him not to because i don't like her. He denied it but i knew he did it so i pretended to be nice to this girl and i simply asked her, I said i know that you know about us, What do you know, and what more do you wanna know. She said that he had texted her earlier when we were at the mall saying that he was going to have sex with me. and called her right after i left and told her every single detail. I confronted him about it and he lied and denied it. I told him not to talk to her about us because i don't like her, she just gossips and announces everyone's business just like she did his when i asked her. but he told her anyways so i stopped talking to him. Now 2 years later i'm out and he is friends with my sister and he keeps asking her for my new number. For what. I said no. I told her not to give it to him. He called her one day while i was there and asked to talk to me so i talked to him and tried that sab story again and i told him to take his lonely BSing story and shove it up his *** and hung up. My sister told me i was mean to him and he doesn't deserve to be spoken to like that. I dis agree, He lost my trust the first time when he tried to munipulate me into coming out, i gave him a second chance and he lost my trust yet again, Now he wants to say that he is in love with me and he jsut wants to have one shot. Um sorry buddy.. this isn't the midnight train to georgia. Plus i'm in a relationship right now and i refuse to entertain his nonsense. am i over reacting? do you think i mean for saying that to him?