Will my bad past make it more likely that Social Services will try to take my baby away from me?

When I was a child SS were involved with me. I hated them. Nearly all my family distrusts them.

I am 19 and my partner in 23. We met in a rehab/homeless facility.

In the past he has smoked weed, done cocaine and MDMA.

In my past I was on weed, cocaine, MDMA, and ketamine, as well as having experimented with magic mushrooms and LSD.

However, the only drug we have done since we started living independently is weed... Which we have both given up since I became pregnant.

He has a history of depression and has self-harmed before.

I am a recovered anorexic who also used to self-harm.

I've currently been diagnosed with Borderline Personality Disorder and I am in therapy for this - I will still be in therapy when the baby is born.

At age 17 I was sectioned under the Mental Health Act.

We live in a studio flat that is barely big enough for us, let alone a baby... So we are currently searching for a one-bedroom property.

My concern is that even though we are not on drugs anymore, and I am receiving help for my BPD, that Social Services will use our (mainly mine) past against us and deem us unfit parents. There is so much prejudice against BPD in the professional services anyway.