I'd sooner blame the ref. Timewasting is a bookable offence, and the ref has cards in his pocket and a handy stopwatch to add the time on. If he doesn't do either then he should explain why.