Not to mention there's usually 2 or 3 espers per stat. So it's not like you have to collect them all to get the job done. The first few espers are probably good enough if you trade them out frequently enough