Yes, it's quite possible to clear the game without using any Espers whatsoever.

But, I had to get at least Zeromus.