In 1979, he joined Billy Cobham's fusion band. Two years later he joined Miles Davis, making his public debut in 1981, a performance recorded on the album "We Want Miles". He remained with Davis through 1983 until he was replaced by guitarist John Scofield. At the time, Stern was a heavy drinker and heroin user. In a 2009 interview, he said, "If Miles wants to put you in a rehab, you know you've got something wrong". From 1983 to 1984 he toured with Jaco Pastorius (a period also characterized by heavy drug use) and in 1985 returned to tour with Davis. Stern and his wife were in rehabilitation; they were also helped by Michael Brecker and others.