If I had a shirt with a Full Metal Alchemist symbol, I'd wear it all the time and not really put much thought in to it.

I'm not sure if I understand what the problem is, OP. Do you not want people to know you like anime or something?