Should I invest emotions or pack up and go?

I met this guy D online, we emailed and soon began texting back and forth. Chemistry is there, we both have the same ideas of marriage, careers etc. He would send me poetry and hopes I was the one he was waiting for. We met and had a great first date. So great in fact the next day we decided to hang out again. We ended up having sex. After sex I made dinner and he stayed 3 more hours laughing and watching movies.

I kinda freaked out because he was only the 2nd guy I've slept with. I began pulling away he noticed and told me he has to be friends first before a relationship and to go with the flow. He states he likes me and is very sexually attracted to me.

I'm still not to sure if I messed things up. He texts that he is thinking of me. If I don't text him first everyday he will text me. He is sweet and our conversations are still in the getting to know you phase. We have talked about sex.

Should I continue to see where this goes with sex involved or am I doomed to be a bootycall?

Second date sex a rule breaker for girlfriend material?