The game has more characters than your typical JRPG (certainly at the time) and also manages to give them better character development than a lot of JRPG's made since that had massive amounts of storage to include all of the dialogue and cutscenes they could come up with.

So no, it wouldn't really have benefited from a smaller cast. If anything, it's better for having such a range of characters.