Yeah, the counter isn't reset by random encounters. It just takes a lot more time if you're running around while doing it.