Man handling, always offensive?

I'm 5 foot 4. I work out and I'm in good shape for my size but obviously I'm not mr.universe... :D 

People often tell me that I'm in good shape. Some people, move me out of the way when there's someone behind me. I work in a grocery store...some guys will try to tug me or physically move me.

I have to admit that I don't like being man handled... I don't think it's personal probably. Still, I take some offense to it, it rubs me wrong. I understand that  if a costumer is behind me that I should move. But you can simply say, someone is behind you... I don't like it when people go for the man handle... I wouldn't do that to someone...

I wonder if it's my size or what but to me it can be offensive.