Is it considered dr shopping if I went to a diet dr and not my regular physician?

My doctors office called me and said they have turned me into the bureau of narcotics because I went to a diet clinic for diet pills, and had to go to the ER one time for 10 pills of Klonopin which I am already on, but the dr couldn't get me into the office till 8 days past my refill. He knew about it, and I know he did, but his office staff are so rude and mean. I have never seen anything like it. Is it really something you can turn into the bureau of narcotics even though I was withdrawing from the klonopin and my insurance nurse call told me to go to the ER? I am really worried about this because I would not think of this as doctor shopping...