I hate drivers lessons!?

Take this in mind that I have never driven a day in my life before these classes. I passed the written test easy but as soon as I got behind the wheel I instantly got nervous, my hands were actually shacking. Day one and two were'nt that bad and eventually I got the hang of driving straight and the hole stop sign and red light rule. For me turning was and still is the hardest part for me. I'm much better at it but I still get these nervous jitters because I make little mistakes.

Well we are on day 3 and I feel that I have improved and so does my instructor but he does little things that piss me off. It's only been 3 days and he expects everything to be perfect! He talks the entire 2 hours and if I dare make even a small mistake he acts like his life is in danger. In my opinion he's moving fast for me and it's getting harder for me to catch on. He's starting to get frustrated with me and it just makes me feel even worse. I kinda wanted to park the car, get out and say screw you when he got mad at me for waiting to turn because I wasn't to confident about getting that close to another persons car. I told my mom what happened and she acted like she couldn't relate so I pointed out all the mistakes she was making while driving.Then to top it off my dad got mad at me for not answering the phone and left me a angry voice mail.When my mom parked the car I had a breakdown.I never cry but I just bawled in my hands. Ps he apologized.Idk what to do? Plus my next lesson is on Friday.