Should I go out with him?

Since primary school, I have known this boy called Sean. After primary school, (note: we never talked throughout primary unless it was necessary) we became close and in yr 8 we went out for a bit. It didn't work very well because it was all new. High school, becoming really close, everything. So we broke up. Then from yr 9 to 10, we were even more close. Everyone knew we liked each other except for us. When he asked me out, I accepted and we dated for 3 months. There were rumours flying for a while that he liked my friend and it caused tension between us. What happened was there was a silent treatment and when I tried to talk to him, he'd ignore my efforts to make the relationship work. After I broke up with him, we were both depressed for a while because we had deep feelings for each other. Now, the 3rd time we went out was longer and better. Then it went all sh*t again because he didn't talk to me for NO reason at all. I had a conversation with him and he went all emotional on me. 'I don't trust myself with you... I'm worried I'm gonna hurt you...' and all these other excuses. I hated it so we had a fight. We stopped talking for a few weeks but now we are friends again. I really miss him and I feel like we are meant to be... I love being with him, he makes me happy (when he's not ignoring me of course) but I'm worried that if I went out with him again, he'll just ruin it and we'll break up again. What should I do?