My issue with drawing isn't so much the process, but the fact that stats junctioned to magic go down if you use that magic. It creates a strange incentive to hoard magic and not actually use it. Since the most powerful spells raise stats the most, you'll want to use them the least.

But overall its a minor drawback.