Of course the opposite problem is characters you love personality wise, but for various reasons you don't use/stop using. This happened to me with Kimahri and Lulu at various times in the game.