I'm so confused about a decision, please help.?

There's a guy that likes me. Same age as me. He's the best guy I've ever met, and I've never liked another guy as much as him. He asked me out, and I said no, but he wants to try again and hopes I will say yes if he keeps trying. He really cares for me, he's helped me through tricky situations and listened to me rant and I've done the same for him. The problem is me. I don't like physical contact very much, and all he wants is to kiss me and hold me, but I don't like it. It's weird and discomforting. I'm not autistic, as far as I'm aware, but intimacy makes me really really nervous and I panicked when he asked me out, so much so that I was shaking and I couldn't think for a minute or two. And it wasn't even amazement, because I knew it would happen. It was just pure shock and fear. I've tried relationships before but I don't have the effort for them, and I just can't show affection the same way he does because it's weird and unnatural to me, and even though I like him I don't really feel attracted to him. I've never really felt attracted to anyone. Sex scares me too, and even though he says he wouldn't want it I know he likes it. He's willing to give up everything for me and it terrifies me, and I feel cruel because I know I can't love him back. I don't know what to do. I hate him for making me feel this way about him and yet I care so much. I just can't unjumble my thoughts, I can't decide. Please, if you have any advice it would be brilliant.

Sorry for all the text.