Only attractive men are allowed to be jokingly (read: seriously) perverted, otherwise it's just weird.

See above.