He was re-elected again in 2003, and in 2005 was appointed Internal Affairs Minister, serving in the cabinet until Labor pulled out of the government. After being re-elected in 2006 he was appointed Minister of Science, Culture, and Sport in Ehud Olmert's government. However, he resigned from the cabinet in November 2006 in protest against the nationalist Yisrael Beiteinu being added to the coalition; and was the only Labor Party minister to vote against the party coming into the government, stating in an interview: