Is it ok for my little brother to get mad?

I'm 23 and my lil brother is 17. He wants to learn how to drive our standard car but he still has trouble with concentrating on the steering wheel, changed, clutch and basic control over all. I have given him lessons a few times but this time, he wanted to move the car out of the slope exit of our house. It's a very steep slop and the car's brakes aren't too good. He took the car without permission and moved it to the edge of the slope, so when I told him to get out, (I was going to drive him to buy some things) he said he was just going to drive it down the slope. I said no, and he refused, so I told him that if he didn't get out, we weren't going anymore. He got mad and got out. Later on, I saw a empty street and told him to drive off it, he yelled at me, "Lets go home" so I said ok. Again, near our house, I told him to drive to the house on that safer street. He said no in a aggressive tone, so I told him that if he didn't drive and was gonna throw a tantrum, that I was never going to teach him how to drive again. He got out of the car and went home walking. Do you think I did wrong? or was he in the wrong?