Rudolph died on July 4, 1979 from a heart attack in New York City. Mendy and Susan Rudolph were standing outside a movie theatre entrance when Mendy collapsed. After unsuccessful attempts at mouth-to-mouth resuscitation, he was taken to a hospital where he died an hour after arrival. At the time of his death, then-NBA Commissioner Larry O'Brien said of Rudolph, "Mendy's contributions to the integrity of pro basketball are legendary." Officials wore a patch with Rudolph's uniform number, 5, on their sleeves the following season after his death, the 1979-80 NBA season, to honor him. No other official in the NBA has worn this number to the present day.