That was my initial thought, but a friend of mine pointed out that Cap could have lived out his life in that alternate timeline and then transported himself back in his old age. Which at least makes a little bit of sense, or at least is plausibly consistent with the movie's loose, pseudo-explanation of time travel.