You won't be able to survive the battles that early in the game, if you walk there.