In 1127, Gilani returned to Baghdad and began to preach to the public. He joined the teaching staff of the school belonging to his own teacher, al-Mazkhzoomi, and was popular with students. In the morning he taught hadith and tafsir, and in the afternoon he held discourse on the science of the heart and the virtues of the Quran. He was said to have been a convincing preacher and converted numerous Jews and Christians. His strength came in the reconciling of the mystical nature of Sufism and strict nature of the Quran.