It's happened to me, and I generally just stare at them funny for a second before leaving.

Unless It is a customer, in which case I smile by default so I never hear it!