as a family that had originally amassed its fortune in the 19th century while rubbing elbows with the vanderbilts and the astors , it gained additional public notice when warren 's grandfather joined the political arena in washington .