Actually, I use magic in my games, and I've never had much problem with doing so, despite the fact that stock tends to decrease. ...Besides. A couple of spells don't decrease stats that much, and with the right Refining abilities, they can be replaced at the end of battle.

...Also, it's fun.