Whats wrong with me?

I'm 6'1" and weigh 165 lbs, 23 yr old male. I eat whole foods like nuts, whole grain bread, plenty of fruits, vegetables and vitamins. I started counting calories about 4 weeks ago, logged everything away carefully for a week and apparently I average 3100-3500 calories a day and am still always hungry. I actually even started eating a little less before I started counting. I'm a runner and when I don't eat at least 3500 the day before a run my performance suffers. My legs get very weak and I hit a wall of exhaustion half way through, whereas if I eat at least 4000 I can really kill it. I hydrate properly before. I run twice a week. My question is, supposedly 2200-2700 cal is enough for the 'average' male my size but it doesn't seem to be nearly enough for me. I don't know if I'm actually needing to eat more because comparing to 'average' daily intake mine seems pretty high that's why I'm wondering if I need to see my doctor. I've eaten a lot my whole life. I've always been able to out eat anyone but I'm trying to be careful because at this age metabolism starts to slow. Maybe I'm not at that point yet.