The Fixed Dice cause he really has to be screwed by the RNG not to pull off more damage than he could with any of his other weapons. Setzer's Gambling weapons are pretty weak, so consistent damage from them is still going to get you anything. If you don't use the Fixed Dice, you better either be using a Merit Award and a better weapon like the Atma Sword, or using him as a mage.