The tradition started with Gilbert Stuart's portrait of George Washington. Presidents often display the official portraits of Presidents they admire (on loan from the National Portrait Gallery) in the Oval Office, or around the White House.