You can't steal the sword from one of the God, only in the final battle, on the 3rd stage. It is Girl that have it hidden somewhere on her. And it really has no use at that point in the game cause....well....just play it, you will know *don't want to throw in a spoiler tag*

[EDIT]Darn you Flying Mullet for being faster than me [/EDIT]