Though Sherman was never the governor or deputy governor of the colony, that he was highly esteemed by his fellow citizens was made very clear in 1676, during the difficult times of King Philip's War. On 4 April in that year, it was voted by the General Assembly that "in these troublesome times and straits in this Colony, this Assembly desiring to have the advice and concurrence of the most judicious inhabitants, if it may be had for the good of the whole, do desire at their next sitting the company and counsel of...Philip Shearman.." and 15 others, including several former governors and deputy governors such as Benedict Arnold, Gregory Dexter, and James Barker. Sherman wrote his will on 30 July 1681, and it was proved on 22 March 1687. He had become a member of the Religious Society of Friends, better known as Quakers. His house, originally built in 1670, still stands in Portsmouth as a private residence, though moved from its original location.