Throwaway lines like this are one of the primary reasons that I do not like games with party limitations.

Final Fantasy VI is one of the earliest introductions of this style of writing that allows a player to customize his party without affecting the outcome of the story. I think that it works for most people, but it causes me to lose interest in the storyline pretty quickly once a game starts throwing these types of lines out.