In 1984 he released his second solo album "In the Heat of the Night" and Jeff Lorber Fusion compilation album "Lift Off". Later that year, he and the production duo of David Frank and Mic Murphy, otherwise known as The System, produced "Step By Step". The title track, written with Anita Pointer of The Pointer Sisters, rose to number 31 on the U.S. "Billboard" R&B chart. The song "Facts of Love" (featuring Karyn White) from the 1986 album "Private Passion" was his biggest chart hit, reaching No. 27 on the "Billboard" Hot 100 and No. 17 on the R&B chart. Several singles from this period also appeared on the "Billboard" Dance charts. However, Lorber was not satisfied that he was being overtaken by a more vocal and R&B feel on his own albums, so he took a seven-year-long hiatus. After "Step by Step", he quoted Clive Davis as telling him, "We really want you to put more vocals on your records", which Lorber thought was a mistake.