I usually go to easy mode if it's a game I'm only really playing for the story, and not looking for a challenge with. If I enjoyed it enough to replay it, then I'll up the difficulty.