Well, I'M a guy and I've never heard of that.

Cute is cute, adorable is adorable, etc.

Also, refusing to accept a compliment on it's face means eventually people just stop giving them to you.