Pretty much the only time I'll leave my shoes on is if the house I'm visiting is obviously dirty. If I take my shoes off, I'll just be getting dirt on my feet/socks and be dragging that around my house when I get home, plus it doesn't seem entirely sanitary.