Buster went to the University of Hawaii in 1928 to study law. He was also offered a place at the United States Military Academy at West Point. Yale University offered him a scholarship based on his swim talent. Only his tuition would be paid, but Crabbe thought he could work to pay for other costs. Yale also had a famous swim team. This appealed to Crabbe. He visited Yale on his way to the 1928 Summer Olympics in Amsterdam, the Netherlands. He liked Yale, and decided to go there instead of West Point. He was 20 when he went to Yale to study law.