I couldn't care less about the number of characters in a fighting game, as long as it's not below 8 or something.

Every other genre though... too many can be annoying, but I don't think it's ever as annoying as too little. I dislike playing a game of any random genre to have only 2 - 5 characters. I want my party to be capable of having a literal party.