 He help posts in the Prussian Legations at Copenhagen, Mainz, Stockholm, and St Petersburg.In 1807 at the Peace of Tilsit when Napoleon refused to negotiate with Karl August von Hardenberg and demanded his retirement, Goltz signed the treaty in place of Hardenberg and the next year became Minister of Foreign Affairs.Goltz represented Prussia at the Congress of Erfurt in 1808.