Born to a middle-class Orthodox Jewish family from Austria as Jacob Orgenstein, Orgen became a well-known labor slugger for Benjamin "Dopey Benny" Fein by the early 1910s. Being ambitious, he had formed his own gang, "The Little Augies", c. 1911. He operated his labor rackets diligently for the next five or six years until his former boss, Dopey Benny, had faded from prominence. His rising star was soon put on hold, however, when "Kid Dropper" Nathan Kaplan and Johnny Spanish were both released from Sing Sing in 1917. While they worked together at first, they soon resumed their old rivalry and each formed his own separate gang.