I think it's made pretty clear that the section of Ivalice you explore isn't the whole world.

I choose to explain the whole thing by Rule of Cool. See here.