When Bush put Porter Goss in charge of the agency, Pavitt reportedly opposed the internal reorganizations announced by Goss, on the ground that they might "do damage to a strategic effort that has produced excellent work on terrorism and a variety of other important issues." On June 4, 2004, he unexpectedly announced his retirement one day after George Tenet. The CIA says Pavitt's decision was unconnected with Tenet's departure. Pavitt was succeeded by his deputy, Stephen Kappes. On June 21, 2004, Pavitt delivered one of his last speeches as DDO to the Foreign Policy Association.