I think the reason I had so much trouble with him is because I didn't have a balanced setup. Red mage X4 can't really go for the quick kill or sustain themselves like some of the other parties.