The only stat that affects your characters is vitality which affect HP. So yes, you'll want switch out mages to monks on occasion to fix their HP totals. None of the other stats affect anything and spell charges are based on the class and level.