Is this discrimination?

Recently an Abercrombie and Fitch executive stated that "we don't want to see fat people wearing our brand". This started a discussion between myself and my coworkers about whether or not this was discrimination. My stance is that it isn't, a company in a capitalist, free-market society is allowed to sell any product they want, and if they exclude potential customers for any reason then they lose that customer base. Their stance is it's just discrimination, plain and simple. Not making clothes for large people and saying that they won't is discriminating against fat people, and there need to be laws in place against such business practices.

Now, I'm a skinny guy, and I know that if I walked into a Casual Male XL store, and pointed out a shirt to a store associate and said "I want that shirt", they might say "I don't think that's your size." I might then say "I don't care. I want to buy that shirt, and I have money." I know I could buy the shirt regardless, even if I was dissatisfied with the fit later. I get the feeling the same could be said of a large person buying from Abercrombie and Fitch.

But all of this is digression. My question is:

While the exec's comments could easily be considered discriminatory, is it discrimination to choose to sell a product that not everyone can use?