Why am I still getting pimples even when eating clean and healthy?

I am a fit male, 24 years old. I started on the Paleo diet one week ago, not to lose weight because apparently it is very beneficial to your skin. One week on and I am getting more pimples, mostly yellow heads and if anything it looks like my skin has got worse.

I am sick of pimples, I have had them since I was 13. I thought it was gluten, dairy, soy all those things, but no matter what I exclude from my diet I STILL get them. It isn't major, but theres probably about 10 on my fce right now, most are yellowheads.

So I started on the Paleo/Caveman diet one week ago and have beens ticking to that.

I have been having quite a few banana chips recently, maybe something like 1- 2 cups per day so I am thinking the oil from those (Coconut oil) could be affecting me somehow?

Please let me know what you think.

Thanks.

10 points will be awarded.