A hat is not an accessory. Headgear is almost always it's own category of equipment.

Unless you are wearing a hat on top of another hat. Then you are in an entirely different setup.