He did just discover it. It is the device that you and Rikku go into that is underwater after you are rescued from Baaj Temple by the Al Bhed. Cid and the Al Bhed obviously renovated it, however.

Sorry about my Cid mistakes .