There isn't a guard in your way. Go north, when you're outside the town gates go to your right, follow the town wall clockwise and you'll find the pub.