There shall forever be an arbitrary limit on the amount of people who can actively fight in your party, and rarely shall this ever be explained. Even plausible explanations never serve to justify not attacking the final boss with every person in the party.