I follow house rules, so if the rules are to have them off, then off they go! If no house rules, I'll just keep em on, unless asked to remove them. As for my house, they're off.
I take off my shoes because I'm polite
I keep my shoes on because I'm stuffy and white