retainers and drinking alcohol ?

Ive had my retainers in for about over 2 weeks.

and last saturday night, i was drinking alcohol and i left my retainers out for about 7 hours, cause i was worried of drinking with them in would ruin them, anyway i put them back in when i went sleep, and when i woke up i think one of my teeth have slightly moved.

i suppose to wear my retainers all day apart from eat,drink,swimming, and wear them all night.

and obviously i want to stick with that, and not ruin my teeth.

but in about 3 weeks time, were having a little party at our flat, and were drinking, so what should i do?

everytime i drink take them in and out? but would that get annoying?

all should i just leave them out when i drink, but make sure i put them back in when i go bed?

Thanks!