I don't take my shoes off in other people's houses unless I'm going to be there for a while and am comfortable.
This. In my own house they come off.