A semite is a person who speaks a semitic language.
This includes non-jewish people such as arabs, and arabs are not considered jewish.
Even supposing you're right (and you're not), it doesn't change the fact that an 'antisemite' is someone who is against Jews. Not Arabs, Mesopotamians, Americans or hedgehogs - just Jews.