Don't worry about that... Surprisingly, stats mean a bit more in this title than some of the others. +2 anything shows a difference fairly quickly after a few levels. +10 would break the game and god knows VI is pretty easy as it is.

If you are going to play around with esper stat bonuses, I'd suggest building to your characters strength as opposed to covering their weaknesses. It keeps their uniqueness.