You can go back and challenge him anytime after the tournament but its harder