My understanding is that 0 HP means the character is so badly injured that he/she/it can no longer fight or even put up any defense from the enemy. If your entire party is at 0 HP, then they are left helpless and defenseless to the enemies, at which point I'd imagine they all get finished off. Or just left to die. Either way, not able to continue on their quest.