I only wear a scarf when it's extraordinarily cold out, and I know I'll be out in it for a long (or at least moderate) amount of time. Otherwise, I don't really need it, a coat's enough.