No. Being a white male does not make you privileged. Just because the majority in power are white males, doesn't mean all white males have that kind of power. I'm sorry. The logic is flawed there.
I don't think anyone is trying to make the argument that ALL white males are privileged or that ONLY white males are privileged.