After leaving Dorsey, Oliver continued working as a free-lance arranger. One of his more successful such efforts was the Frank Sinatra album "I Remember Tommy", a combined tribute to each man's former boss---and as music director for Decca Records.