Should I contact my ex after breaking it off?

I've been having a long distance relationship with a guy for the past four months. It's been getting really serious, but for some reason every time we get so close he pulls away even though he's aware of this strong feeling for me, and wants to pursue more. So after he started pulling away I addressed the issue, and said I was concerned he was afraid of commitment, and asked him why he contacts me less, and avoids my texts. He said he didn't know what brought it on, and I should stop second guessing him. I didn't really feel he took what I said into account. So I told him actions speak louder than words, and I told him I felt he could probably have a relationship with a non-committing girl because it was safe. Then I just broke it off over text, and said sorry it didn't work out. I feel real bad about the situation and would like to keep him in my life, maybe just as friends now since this happened. But he's real touchy, and holds grudges and probably won't reciprocate. How bad is it to break something off then take it back?