Complicated affair?

I'm married. Got attracted to a male colleague. He said he wants to sleep with me. I shared my feelings that I'm attracted to him as well. He was happy to hear that but said he likes me too but the friendship is more valuable. As a woman I may get emotionallly attached and want more attachment which may put pressure on the relationship and break it.

He still talks to me , we meet outside work for coffee and talk a lot. He says he respects my personality and IS a good friend to me.

I'm still confused how a man like him can hold back his feelings for me especially knowing that he is well known for one night stands?