Internet Explorer
The idea of removing a stock install of Internet Explorer from a Windows system was proposed during the United States v. Microsoft court case. One of Microsoft's arguments, during the trial, was that removing Internet Explorer from Windows may result in system instability.