I also heard that he'll disappear if you enter the final dungeon, so you have to do this side-event before entering the final dungeon.

At least I think. My memory's hazy on that one.