It stays for the rest of the game and it's also quite challenging. You can also recruit some good units there, like swordsmasters, dragoons, and ninjas (which it seems you just got).