Zijlstra served in the House of Representatives from 1967 to 1973 as a member of the Anti-Revolutionary Party. Between 1975 and 1981, Zijlstra was mayor of Smallingerland. He was elected to the Senate between 1983 and 1995, representing the Christian Democratic Appeal, which had absorbed the Anti-Revolutionary Party in 1980.