The only reason you need to go to the Ice Cavern is to get the floater, which gets you the airship. And since you have the airship and class upgrades, there is no further need for you to hang out in the Ice Cavern.

And yes, there are two exits from the Ice Cavern, and both take you back to the same spot on the world map.