Of course, that's how I normally play. Most spells don't really need to be leveled past 5 or 6 (for the healing ones anyways, dunno about black magic) and they'll get to that point naturally throughout the game if you use em when necessary. As long as you don't switch weapons out all the time they get high enough leveled too.