Personally, if I'm going to be there later in the game, I don't touch the chests. So if you know a location will still be intact in the WoR, leave the chests alone.