Where did you make the connection between "hate crimes" and freedom of speech? If somebody starts saying things like "you should kill all (group) because they're (insult)", that would be a crime, as it would be inciting violence. And why would it matter if it's against a certain race, or any other group of people? If I say "all lawyers must die", is that somehow better than saying "all black people must die"?
There's a difference in somebody who walks around with a sign that says "these people should die" and somebody who murders somebody else. And having equal punishments for murders doesn't have anything to do with free speech.