You do have a ship in the present right?

Start at Fishbel. Sail up the eastern coast of Estard Island until you can see the Ruins. Then sail due east and you'll eventually reach a whirlpool off the western shoreline of the Hamelia continent. That's the entrance.