Just to double check, in about:config, is the setting "browser.startup.homepage" set to 3? You are also making sure you exit the browser with everything open, rather than closing all the windows one by one?

Have you tried with a new firefox profile and/or clean install to see if it still does the same thing?