In the summer of 1983, he established a non-profit organization called the "Sephardic Association of Torah Observers", and served as its chairman. In addition to educational, cultural, and charitable activities, the association was involved in the selection of representatives to appear as a political list for the elections for local municipalities and the Knesset. The first meeting of the association convened shortly thereafter in the Yesodei Torah Yeshiva in Jerusalem. Participants included the president of the Torah Elders Council, Chief Rabbi Ovadia Yosef, as well as Rabbi Shalom Cohen, Rabbi Yehuda Tzadka (Head of the Porat Yoseph Yeshiva), and Rabbi Shabtai Aton. With their blessings, the Shas party ran for the first time for the local elections in Jerusalem, with Ze'ev at its head, and succeeded in winning three seats. Between 1983 and 1998, Ze'ev served as deputy mayor of Jerusalem in charge of the Welfare Department, as well as chairman of the Allotments of Land for Public Institutes and chairman of the Exemption Committee for Arnona.