It was a pretty poorly designed minigame for a Final Fantasy installment, but I was never particularly bothered by it.

It's not as if there is any obligation to win the single required match, anyway.