I skimmed the article to get the to "why is it annoying" part. A second glance and I also found this: "A single vuvuzela played by a decent trumpeter is reminiscent of a hunting horn – but the sound is less pleasing when played by the average football fan."
So the lack of quality plus the quantity. I get that.