According to a 1979 article in the New York Times, Edward Ball at various times was called a Robber Baron and a political power broker; a clever man with a dollar and a dangerous man to cross; a courtly Virginian with the ladies and a ruthless foe. He is known for "orneriness" but insists his reputation is undeserved; he claims he was just a trusted functionary who did his best for the institution he served. Critics say he hijacked the trust as a tool of his personal power, treating the assets like a miser hoarding every coin. He had the reputation of a "tart-tongued, hard-nosed conservative financier".