One way back is to cross Mt. Kolts(again, if you aren't there already) and go to the Returner's Hideout. From there, head back down to the back exit to the Lete River and ride the raft. It'll spit you back out at the crazy, old man's house and you will need to walk south, then through the Phantom Forest, to get back to the falls.