True but they have to put a limit to what is in the game at some point. And I think the fact that they let you go into practically every single building and every single cave and basically let you explore every nook and cranny in cyrodill is quite impressive.
If they let you explore the entire Elder Scrolls continent than some would get upset that they aren't allowed to leave the continent. Just a situation where you can't make everybody happy.