Reinstall Firefox, or use Mozilla instead ?

You might need to tell IE to stop checking the default browser settings in CP > Internet Options > Programs too.