I don't get the whole 'ninjas wear nothing but underwear' insinuation.

I mean, none of the ninjas I've seen were just in panties and boxers. Generally they seem to have a few more clothes than that.