What do you mean he was kicked out before?
You get the Minimog from Balamb Garden.
Loose it to the card queen before your first mission.
She goes to Deling City.
You go and Fight the Brothers due to the Training Exercise Rinoa's Father General Caraway told you.
Get back to town, loose the Sacred card there and when you arrive at FH it will be there.
And you Garden Master Martine didn't loose his post yet.



There's also another theory that consist of Irvine's Manly Charm.
And another about Ward running after Odin for too long. (There's a hole in my pocket) (Oh no!) Ward loose the Ward card.
No? meh, they ran out of characters, I guess.