The dating game..................?

Seperated from my husband at the time of 10 years and only real relationship I have ever been in. A little over a year after the seperation I fall for my mister right. Now, almost a year since then, we are here. He's still great to me. He loves my kids and I adore his. There isn't a doubt in my mind that my love for him is one of those everlasting kindda things to where even if it didn't work on the long run, he will always have most of my heart. I look forward to his phone calls and his coming home everyday. I would go to the end of the world and beyond just to know that I have made a single day for him one of the best. The problem? Ehhh.....me maybe? Due to my marriage to the high school sweetheart I have jnsevurities that stem from things many have never been through and many I have never even spoken of. Not even to the man I'm with now. Then there is his extensive (current, not ex's) past. It doesn't anger me...I mean it was his past. I wasn't a part of him then the way that I am now. He had some pretty hurtful experiences himself that ultimately led him to that bachelor lifestyle. It just worries me. So you have my insecurities of myself and trust issues. Then there are the what its that come along with his past. What if he misses it, what if he reverts back to that, what if I myself can't be what satisfied him with that lifestyle. I know whatever is gonna happen will happen but truth be told it would wreck my whole world...and the kids as there daddy has totally walked out of their lives in the past year. This guy has filled a gap in all of us. So that leads me to the what its. As long as he is setting aside time for us j am OK. But now we are moving in this new house so between work and remodeling and life, we haven't had that time together lately. I asked him last night if he could just spend an hour with us and not worry with everything else at some point over the weekend....he got defensive for himself and didn't seem to understand