There are three separate timelines, with the point of divergence being Ocarina of Time. But yes, the games are connected. It's all spelt out in the Hyrule Historia, but you can find a summary at the Zelda wiki.