Is it just me?

Quick bio: Four kids from previous marriage.9 month old baby with "him". Previous marriage full of physical and emotional abuse, cheating, leaving, drinking, you name it and I dealt with it from the ex. A year and a half after the separation and my swearing to never catch feeling again, He steps into my life.Never misses a ballgame, a school event, never left my side. Through the dating process there was a pregnant girl with several possible "baby daddies"(yes I knew this going in). And (You guessed it) the kid was born and after fighting for DNA it comes back... 99.99999. Not even a month later, + pregnancy test. So my guy goes from single bachelor to pretty well father of 6 in a year (being the biological took off and has nothing to do with the kids)Yikes! Here we are now, step kid is 2 and after a loooong court battle we now get the whole every other weekend thing. And so the big story and question begins..

I support him through the pregnancy,DNA,court hearings.the constant baby mamma drama. We get a house together, share bills, and call ourselves a family.He was once super close with my kids but they have grown apart a good bit.He doesn't attend things the way he used to and when we argue he wants to be left alone and refuses to talk it out and leaves.So Im left alone with the kids and dealing with my emotions alone.It hurts.I wonder at times why the three men I once loved most bail on me-dad, ex, him.Is it me?What can I do different?How can I get him to talk to me?