FFIX. Not just because it was an awesome game, but because it marked the end of what I'd consider my childhood. Sure, I liked both FFX and XII but they don't bring up the same type of nostalgia I have for the older titles.
In terms of when the series actually turned sour for me, well that happened only last March when FFXIII was released.