yes, Bahamut may destroy the broom's body, but he cannot destroy his spirit.
What but that's not what you said earlier.

I imagine Bahamut will waste all his energy trying to kill a broom (which can't be killed, it's not alive)
But your contradicting yourself. If the brooms not alive then it can't have a spirit.