I think it's almost all psychology.

You listen to more tone of voice than anything anyway. try it yourself -- go to Youtube and pick a language you dont actually speak (like chinese or something). Listen to it. You won't pick up the words but you will pick up on a lot of other stuff. It happens all the time.