It's my understanding that the four fiends were Garland's contingency plan in case he was ever defeated. Weapons - yes, in a sense, but maybe not the planet's. They're Garland's Eye of Agamotto, his Time Stone. Before he begins, he sends them to an appropriate point in time to bring him back to start over should he fail. "Light Warriors, I've come to bargain."