Well, over half are missable. The most important ones to take note of though:

Pahn - Lose the duel later on and he's gone.
Milich - As much as you'll want to, don't kill him.
Leon - Talk to him in Kalekka when your castle is at max capacity. Make sure to do this immediately.

If you need any additional help on character recruiting, feel free to PM me.