I interchange them (when I use them, which is hardly ever) but I think Ma'am is probably a little more formal. Some women may consider being called Miss to be degrading.

Can I ask who the "holy one" is before I vote?