In 1958 Rau and Heinemann joined the Social Democratic Party of Germany (SDP), where he was active in the Wuppertal branch. He served on the City Council (1964-1978), where he was as chairman of the SDP Group (1964-1967) and later as Mayor (1969-1970).