Polly and Crosby purchased their first race horse in June 1924, and then two more in April 1925. At the end of 1924, Crosby persuaded Polly to formally change her first name to Caresse, as he felt Polly was too prim and proper for his wife. They briefly considered Clytoris before deciding on Caresse. Crosby suggesting that her new name "begin with a C to go with Crosby and it must form a cross with mine." The two names intersected at right angles at the common "R," "the Crosby cross."