Rahman was born in Tungipara village of Gopalganj District. His father, Sheikh Lutfur Rahman, was a serestadar, an officer responsible for record-keeping at the Gopalganj civil court. He is the third child of his parents. 