When I first meet Judge Ghis I wanted to test to do a quickening chain for the first time in the game and I did one and got Inferno and It killed him directly so the battle was over before it even had started.

If your level is good enough then you wouldn´t have any bigger problam with the soldiers showing up all the time. I leveled my characthers untill they could defeat the soldiers showing up. So I didn´t need to run all the way down to were Ghis can be found.