Remember, he was training in the mountains before joining the party. He likely grew the beard then and one of Vargas's bears ate it for some reason.