I do like Grahf, but ID was the standout villain of Xenogears for me.

For Saga? Albedo, Dmitri, and Wilhelm. Easy.