I think it's annoying because they fail to appreciate the level of nuance in any given persons personality. Psychologists try their best to explain this sort of thing, but its nowhere close to becoming a hard science by any stretch. Calling someone a "strong but silent type" just files someone into a quaint little category. It's annoying because they think they "get you" by slapping on some label after observing your behavior for 10 minutes.