When it's time to go to Temple of the Ancients, don't go to Temple of the Ancients and grind it out then.