Level up a bit and try again. It's all a matter of outlasting him. Flame Shields are a plus. Quickenings can help dispose of the small fry.

BTW, you can run away from this boss fight and save at the crystal.