Check the guide in the FFIV section. It has directions to get the crystal sword. I would explain it here but with secret passages and such make it complicated.
(And I'm lazy)