In 2004, he was elected a Member of the European Parliament and was the Chairman of the ODS in the European Parliament. Between 2004 and 2009, ODS MEPs sat with the EPP-ED grouping in the European Parliament, but after the 2009 elections, several members of the EPP-ED left to join the newly formed European Conservatives and Reformists (ECR) grouping, which was based on the Movement for European Reform, an alliance between ODS and the British Conservative Party. In his capacity as Chairman of ODS in the European Parliament, Zahradil reportedly led negotiations in forming the new group which after the European elections in 2014 become the third largest group in the European Parliament.