We do not negotiate with terrorists. BAN HAMMER!

And I do mean permaban. Once they're gone, shift things around to make whatever "secret" obsolete, like changing the FTP password once a site admin resigns.