Nah, you go around it if you want to go back. At the T-intersection where you turn right to get to the cliff you jump off, instead turn left, and follow the road.