Please help, I have problems with my driving instructor...?

Okay, so I'm a 17 year old girl currently learning how to drive but my driving instructor is very rude and causes me to make mistakes and become nervous. I told my mom about this but she wouldn't let me change my instructor as she said my documents are all with them and she has paid for the whole course. And she thinks that I'm just being whiny since my brothers who had learnt with him had no complaints although one of my brother's did complain to me about him. Truth is that he constantly shouts at me and tell me that I'm a cry baby when I actually have never cried infront of him. He shouts at me for every single mistake I do and I tremble. He even hit me with his elbow when I was reaching for the gear when I hadn't pressed on the break completely. I had to take more lessons cause he said that I'm a terrible driver when in real I think the reason I keep driving like a stupid person is cause I get nervous with him constantly shouting and mocking me. All I can do is just nod and smile, cause knowing the person he is if I confront him, things are gonna get worse. Help me how to gain confidence in driving when my driving instructor is constantly shouting in my ear ? :( I'm just scared and I get butterflies every single time before my driving lesson starts...