Hmmm...well, they DID know that he traveled through time to save the world since adult Link was known as The Hero of Time. Maybe they knew that his adventure started when he was a child, which is why they make kids dress like The Hero of Time when they are younger.