I just chastise them until they learn their way. Failing that, I often enjoy changing their passwords and other (admin power) abusive actions. I also change their emails just for fun, so they can't get their account back.

They eventually leave, and I eventually get kicked out of admin position. It works out in the end.