You can't remove explorer as it's a major part of windows.

Just remove the desktop icon and start menu items and set firefox as your PC's default web browser.