Go to about:config, change browser.tabs.closeButtons to 2 to remove all close buttons. Or change it to 3 to get the single close button back on the right. Try other values too.