I don't address people by name, rank or serial number at all if I can get away with it. In general, someone will know I'm talking to them by my intonation and the direction of my focus toward them.