Does this bother you.......?

No but I dig it when they think they can speak Spanish and I won't know it cause I don't "look Latina" and they talk about me and I know what they're saying. LOL

Not at all. If they're not talking to me I have no interest in what they are saying.

Look at it this way using your elevator example...

What if they were speaking your language (let's say English) but the content of their conversation was highly scientific quantum theories, which you didn't understand a word of?

Would that bother you? Would you get the urge to turn to them and say "I know you two aren't talking to me but I can hear you and and I think it's very rude. I insist that you continue your discussion in laymens terms so I can understand it."?

of course not. if you were staying in another non-English speaking country, you would still speak English with your friends wherever you were, laundry room or elevator.

my friend and I were in Russia, we didn't know Russian, so we spoke English to each other and no one complained. after all, I suppose we could have learned sign language and used that.

Of course not. Why should they have to speak to each other in a foreign language? I speak my language with the people of my country; they speak theirs. At home or abroad.

It makes me curious. But that's my problem.

Not really. There is a chance the person may not even know how to speak English.

No. Why should it?