Is it normal to get sick this often and this bad?

A little background. I am a germ-o-phobe I am all about hygiene, I wash my hand properly, use hand sanitizer, don't touch my face, etc. but ever since I can remember I constantly get sick and always much worse than anyone else I know. For example my husband may get a cold, he is sick for maybe 3 days and does not miss work and by the 4th day he is just blowing his nose and getting rid of the residual. I will get the same cold be sick for 3 weeks, get a fever, miss several days of work, get so dizzy I can't walk, be so tired I can only stay up for 2-3 hours at a time. So far this year, I have kept count for fun I have been sick 9 times and I live in a tropical climate. I have visited a doctor on several occasions for this throughout my life and they always blow me off saying you work around people, it just happens, you are being a wimp. Also I live with 2 elderly people and I try to be careful around them but in the 2 years I have been living here and the amount of times I have been ill they have never been sick, I just find that odd as I am an otherwise healthy 28 year old. I take vitamins, get sleep, have a fairly good diet and I exercise. Any ideas? Is it really normal get get this sick and get sick this often? And how do people function? I pushed myself into work last week with a 103 fever, I have to as I get sick so much I can't miss work all the time. It is getting really old and depressing. And I am not going to the doctor again to give them $90 to tell me I am a wimp and nothing is wrong.