Not really. I just think, "maybe that's a pic of his girlfriend or her boyfriend."
It's not being a specific person that confuses me, but when I see "Anime Chick Avatar" chick registers in my brain if I know nothing about the person. Non-gender related things seems to not matter though