Holy crap, you really are bad at this!

But it can still be fixed Remember, the color of the background by the portrait during a battle indicates the side. Red is for enemies, blue is for your characters, and green is for guest characters who are fighting on your side but you can't control them.