It has to be a reference, simply because of the state of the world of II. Does the world of IV look anything like it? Not that I can see. None of those Kingdoms are in existance in the world of IV. There's too much difference and not enough time elapsed (if he's the son, then it would have to be... what, 10 years?) for it be the same world.
