That's more than likely why the term was invented.

A guy was chatting with some other guys and admitted he really liked...I dunno, some hair metal or girl group band. Then when his pals started ripping into him he said "well I don't REALLY like it. It's just..a guilty pleasure."

It's how I always justify liking t.A.T.u..