In 1889 Wanamaker began the First Penny Savings Bank in order to encourage thrift. That same year he was appointed United States Postmaster General by President Benjamin Harrison; he was accused by the newspapers of the day of buying the post. Wanamaker was credited by his friends with introducing the first commemorative stamp and many efficiencies to the Postal Service. He was the first to make plans for free rural postal service in the United States, although the plan was not implemented until 1896.