I know for a fact that you can:

A: Easily get through the game without Blue Magic

B: That the "castle" in the Cleft of Dimension has Death Claw-Type enemies that use it waaaay too often for their own good, so it's not missable. Infact none of the Blue Magicks are missable during the game, they can all be found in World 3.