how is this going to play out?

I live in Nevada with my three year old daughter. I have recently told her father (we are not together) that I don't want him in my daughter's life anymore. He lives in California. Has no job and a prior record. All he cares about is getting high. We are both young I had my daughter when I was 17 andthiught that even though and her dad broke up I still wanted them to have a relationship. She is three and in the past three years he hasn't made any attempt to see her or talk to her. He only shows up on her birthday which I hold out there every year because that's where both my and his families live. I was letting my daughter go to his moms house because he is homeless and I wanted her to know them all. But, all they do is fight and disrespect everything I've ever asked for them to do. I told them no fighting around her, they do anyways, I've said none if his girlfriends are allowed around her unless I meet her first and approve, they still had his girlfriend around and lied to my face about it. It's been rings like these that have been going on over the years. I always tell them what I do and don't feel comfortable with, but they don't listen. So finally I got fed up and said I mdont want them around her anymore because its nit healthy for her tod be around them..(oh, and my exs moms husband has his medical marijuana card and smokes around my baby, after I said I don't want it around her at all. He can't even wait for her to leave, and he doesn't even go outside for a walk or anything he smokes it in th house!)

I also have reason to believe she's being abused in their home and in waiting for her appt with her doc so I can get her in to see a specialist.

So, my ex is never around. My daughter is mainly with his mom and her husband.

So basically I told my ex and his mom that if they want to see her they can take me to court.

I think that my ex is actually going to take me to court which really I'm nit worried about at all. I'm a good mom i don't do drugs, I don't party, I stay at home with my baby and be the best mom I can.

While he, on the other hand has been in lots of trouble with the law, and gangs, does drugs, party's and he never ever tries to contact me to talk to our daughter, which there are several different ways he can. Also, I take trips out there at least once every two months so she can see our whole family. Whenever we are there he doesn't come see her (he knows where we stay)

He's saying he loves her, I don't doubt that I just don't think he really cares about her and he would rather live his life the way he wants. He's never worked, never bought her anything unless his mom bought it and never even offered me some money for her. The money isn't the problem, we hold up just fine on our own.

I've tried and tried with him and his family, all they do is manipulate and guilt trip me and say I use my baby as a tool.

I don't feel like I do at all my thought is that he's never around so why even bother especially when.he doesn't even try?

My daughter doesn't even know who he is. She sees him and wqlks away or jumps into my arms.

I've never said anything bad about any of them to her because I feel its not right.

So, if he takes me to court what will happen? Especially since we live 5-6 hrs apart and I'm planning on putting her in headstart soon and getting a job if my own. (My boyfriend provides for us right now) after I get a job, I won't be able to go out there as much as im used to, and he nor his mom or anyone in his family ever come out here. They never even offer.

I hate the thought of having to put my daughter through bouncing back and forth between here and there. And I'm not at all comfortable with her staying out there without me with her.

Id like to hear from people who have had experience wuth this type of situation.

Please no negative comments. Or opinions on how I should raise my child.

Thanks.