Jelinek taught for 10 years at Cornell University before being offered a job at IBM Research. In 1961, he married Czech screenwriter Milena Jelinek. After IBM, he went to head the Center for Language and Speech Processing at Johns Hopkins University for 17 years.