I think a great way to do that would be to not show it as part of a post-battle screen but instead to show it as a little bubble (a la Windows bubbles) at the bottom right of the screen as you walk around just after the battle. I think that would allow you to keep track of things without accidentally skipping past the post-battle screen, but also negating the need for an exclamation mark type thing.