There must either be something wrong with your install, or some weird option enabled, because all the customizations I've made stay the same every time I open/close Firefox. I just tried disabling the Bookmarks toolbar, exiting, and starting Firefox back up, and it was still gone.