Is this guy interested? What do i do?

I've known a guy for 2 years now and we've only ever been friends. A few times he's put his arm around me but only when we've alone. Today when we were alone in the classroom he randomly held my hand and looked my in the eyes. We didn't say anything- we were just staring into each others eyes. Sometimes he gets really mad and swears at me n' my mates. We try to take it as a joke. He even asked me to come over to his house on the weekend coz he has something to show me. Should I go? I think I love him. I don't really know how i feel about him.