I was of the impression that Barret's reaction was due to how adult and worldly Red normally acts. They assume he is old and wise, which they make another joke about when they meet Bugenhagen and he reveals that he is the equivalent of a teenager. From Barret's perspective it would be like overhearing Gandalf mumbling about his mummy in his sleep.