You realize they were able to be there due to some intervention from the Moment right? The events are time locked and without the Moment letting them go back to that point they couldn't be there.

It's not like visiting time locked events never happened before. We know Dalek Caan did it so it's not impossible. Just really, really difficult.