On Thursday, July 31, 1980, Rafi died at 10:50 p.m., following a massive heart attack. He had four sons (Saeed Rafi, Khalid Rafi, Hamid Rafi, Shahid Rafi), three daughters (Parveen, Nasreen, Yasmin) and 18 grandchildren.