You have to play the 10 Gatekeepers mini game, and after you've finished it, it stops.