Tactics is the only game in the timeline that is any good, so I wouldn't worry about playing them in order anyways.

In reality the connection between the (FF12/TA stuff) -> (FFT) -> (Vagrant Story) is so marginal I could imagine a casual player not even realizing it exists.