lets see here..you know that place where the ground shifts and you have to place markers to see where your going? it has four entrances/exits. to the north is the old guy's place, to the south and west takes you back to the old map area, and to the east is the exit where the lady's cave is. you start out facing north when you arrive at this area, so you need to take the right exit place.

so, assuming that the area doesnt turn and distort you, you leave the old guy's house, head down a bit, then go east.