After the Canzoneri bout, Berg continued boxing with mixed results. He became British lightweight champion in 1934 by beating the title holder Harry Mizler, another Jewish boxer. He was thrust back into the limelight as a replacement for the injured Canzoneri against Cleto Locatelli at Madison Square Garden, but his hopes of challenging for the world title faded after a points defeat to Gustave Humery in Paris in February 1935, also losing a return bout in London in April, although Berg was still British champion at this point. Later that year he lost to Laurie Stevens in a fight for the British Empire lightweight title in Johannesburg. He returned to fighting at welterweight in the United States with some success. In August 1936, after three straight defeats, he announced his retirement, but returned in January 1937 with a victory against Ivor Pickens, the first of a nine fight unbeaten run. In January 1941 he moved up to middleweight to fight Harry Craster. He again beat Mizler in February 1941 and defeated British lightweight champion Eric Boon on a disqualification due to a low blow in a non-title fight in April 1941. After a victory over Eric Dolby in March 1945, Berg expressed a desire to once more challenge for a title, saying "What I need is fights. I'm a bad gymnasium worker, but I'll show what I can do in the ring. When I've had a few warm up fights I'll know where I stand. If I'm no good I'll quit." He had two further fights, the last a win by knockout against Johnny MacDonald in May 1945, before retiring.