You have two choices when this sort of thing happens:

1, Let the clumbsy puller die resulting in just his loss of exp and a little downtime.

2, Fight and risk a full party wipe resulting in everyones loss of exp, less chance of raise and possible disbandees and this means a lot of down time.

The choice is obvious, you shouldn't have to lose exp and time because of someone else's mistake and perhaps unwillingness to deplete their own exp a little (due to their own mistake) to protect everones exp. In my opinion it's quite selfish to expect everyone to risk their exp and time for yours.

If someones pulls an extra mob that we are not able to handle in my parties I expect them to sacrifice themself, just as I do when I'm pulling.

Though this is what I think, if everyone else engages I would just join them and seal my own fate. Since you said "I just left them there" I'm going to assume they all wiped, if that's so you were the only one not to engage. Even though it's a smart move and you meant well, I imagine it looked pretty bad which is why they kicked you. Next time you have a rather dodgey puller explain to him that if he pulls another link you are not going to engage.