I leave them alone. They kill other bugs. Unless it's a poisonous one, then it needs to die. There was a banana spider (or whateve they call them here) above my trashcan for a while. I would throw grasshoppers to her. I named her Jolene.