None of those characters had more than 500 LP when I got them, so I think it's probably based on how much you gain before getting them, so they aren't super behind and stuff.

When do balthier and fran actually leave the party? They leave you, but that's just when they're walking around? It's been a while since I played the first part of the game x.x;