This game is pretty notorious for allowing you to wander to places you aren't supposed to be until later in the game. Just stick to the route you're supposed to take and you should get strong enough naturally just going through the game.