Need help, don't want to loose this new relationship.?

Two days before thanksgiving I called this man that I was intrested in and we started seeing each other, I felt that we connected in a very special way and he even commented on how rare it is for two people to connect to each other in the way that we did. I had just ended a 11 year relationship with a man whom for the past 8 years was more of a friend and roomate than lover. If we had sex once a year I considered myself lucky. He would never explain to me why he did not want sex. I was very happy and felt whole once again in my life. My former live in found out about it and verbally attacked each of us, myself and the new man I connected with. The former and the new man knew each other. I question how well since the new man knew my former live in by his nickname but did not know his real name until just last Saturday. I am really upset with the situation and the new man no longer wants to see me. I miss him a bunch. I thought for sure he was the one for me. What can I do to get us back