I wouldn't think about it.

The closest cop out answer I can give is that since the crystals themselves are basically keystones holding the universe together, they allow this little time slip up to happen. It's not exactly like Chaos and the Fiends don't magically appear out of nowhere as well and suffer a bit of a chicken vs. egg scenario.