No, You can get the second Atma Weapon onlt in the 3rd Stage of the Final Boss...

The item you can steal from Goddess is good too... It's a Minerva Armor, as far as I remember... Or was it a Sky Render?

I can't really remember now, but it was something very good.