You either walk up to the fence hitting your "confirm" button and you jump back over or you have to walk along the fence and through the woods and out of town that way. I can't remember which though.