It can be done. I also know people have solo'd a White Mage, but that requires a lot of luck. As for the four White Mages, you'll have to be patient as battles take a long time. Also, items that cast offensive spells are your friends.