Is it selfish to seek careers that deal with things that you've experienced?

Two of the careers that I have wanted to pursue, working with people with autism and helping obese children, have been spurred largely by the fact that I know what it feels like. I wanted the opportunity to help someone else sort of not have it as bad as I did. Is that selfish or closed minded? People have told me it's better to help causes that you have no connection to because you're being more open and generous with yourself but is it really that bad to choose something that you've experienced?