Khandro, you are doing your best, heaven knows, but it' not going to fly.
The response "Yes, but where are you really from?" clearly shows that the response wad heard, understood, and found unsatisfactory.
The response to an answer not heard I'd something like "I'm sorry I didn't hear, I am a little hard of hearing ..."
I know you have nothing to work with in your defence of bad manners, better quit while you're behind.