It sounds kind of tedious... why not just have bonus points you can get at end-game through mini-games and other fun things, other than just grinding?

But yeah, it'd be one way to specialize your characters a lot.
i.e. One guy being the main tank through defense and vitality stats and gear (maybe even customize certain skills for him), another could be a healer that has mind and certain gear/skills, etc.

Anyways, just some random thoughts.