Unerring Path garment grid is good for that. You just have to change once before you can switch to the special sphere. But even if everyone participates, if you when the battle using a special dress sphere, only that person get EXP and AP (from defeating enemies, all other AP is awarded)