Ahhh, so that's why they leave my party, declare hostility in town, ally with me again, and then suddenly I'm dead?

Or maybe I'm not paying enough attention... But I could have sworn that's how it was done...