 His son, James Harman, was a captain in the navy and died on 19 January 1677 in a fight with an Algerian cruiser.The National Maritime Museum, Greenwich, London, has a three-quarter-length portrait of Harman by Peter Lely, part of the "Flagmen of Lowestoft" series of 13 portraits of senior ship's officers in the Battle of Lowestoft commissioned by James, Duke of York.Harman is turned away, looking back at the viewer over his left shoulder.