Managed by Al Weill and trained by Charley Goldman, the "Herkimer Hurricane", began his career losing only once in more than three years. He faced his greatest competitor, future hall of fame lightweight champion Tony Canzoneri on May 10, 1935. Canzoneri defeated him over 15 rounds on a decision in Madison Square Garden, robbing Ambers of his first shot at the title. Canzoneri had Ambers down twice in round three. A faithful crowd of 17,433 cheered as Canzoneri easily retook the title, knocking Ambers down again shortly before the closing bell.