Although legend (and Groucho Marx) claimed Berlin wrote the song "Always" for The Cocoanuts, he never meant the song to be included in that musical, and it was not.
Despite the legend and Groucho Marx's claim, Berlin did not compose "Always" for The Cocoanuts; he never wanted the song included in the musical, and thus it was omitted.