You can just send out imps to take on the ghosts, it's a lot easier!