Its not really double standards, that's like saying, "Why do boys go topless when swimming but the girls don't?" Although I don't think the men would complain if women started swimming topless.
So why does he wear a towel on the lower half of his body when he gets out of the shower.