(CNN) -- The publication this week of memoirs by Leon Panetta has stirred up a sharp controversy in the press, but as so often happens these days in Washington, the focus seems to be on the sensational rather than the important. And that leads to the larger argument: whether Panetta, Bob Gates et. al. should have published these books may be controversial, but it is a sideshow compared to what's really important -- and that's what they have to say about the making and execution of American foreign policy these days. White House aides and allies of the President were naturally upset to read some of the stinging comments by the former defense secretary and CIA director about the inner workings of the Obama administration. Overlooking the fact that Panetta was also generous in his praise about the President, they set out to slime him.
@highlight
David Gergen: Obama allies focused on whether Panetta should have written book so soon
@highlight
He says Washington insiders have been telling tales on administrations since Nixon
@highlight
The real problem is a swollen and all-controlling White House staff, he says
@highlight
Gergen: Experienced leaders like Panetta need to be given scope for decision making
Panetta and @placeholder had purposefully moved far away from Washington and wanted to stay away.