In 1928, Harry's cousin Walter Berry died, leaving a considerable collection of over 8,000 mostly rare books. In his will he left "all the rest of my books...except such books which Edith Wharton may desire to take...I give and bequeath to my cousin, Harry Grew Crosby." Harry eagerly campaigned to persuade Berry's long-time friend Edith Wharton to give him a great many of the books, and in the end she kept less than 100. Harry prized the collection at first but he became enamored of the idea of reducing the things around him. Caresse later wrote, "We had talked to a wise man in Egypt in 1928 who said, 'My wealth I measure by the things I do without,' and Harry believed the books weighed him down." Every morning he would leave with a satchel full of rare books, despite Caresse's attempts to persuade him otherwise, and give them to waiters, barmen, and cab drivers; sometimes he would sneak them into antiquarian bookshops that lined the Seine with ridiculously low prices penciled into them.