Negligent accountant?

I set up a limited company over two months ago and appointed an accountant who was to help with company registration, VAT etc. I have been waiting all this time for my VAT number but up to yesterday it hadn't been issued, although my accountant said it had been applied for both by post and online and that she had been issued with a temporary number for me to use. I submitted some invoices with this 'temporary number and, of course they have been returned unpaid because the number is wrong. I phoned the VAT office yesterday to see if I could find out how my application was progressing and to ask them about my temporary number. I was told by them that there is no such thing as a temporary VAT number and also that they had no record of any application for VAT registration for my company. This matter has put me at serious risk of having to close down the company as there is no cash-flow until I can get registered. Can anyone offer me any advice on what my options are?