Oh, they're villains all right. Even Big Bads. But not primary antagonists, and that's the difference here. An antagonist doesn't have to be a villain, just someone opposing a protagonist. If they're their main opposing force throughout most of the story, they're a primary antagonist. So Xande, Golbez, Edea, and (arguably) Seymour are primary antagonists.