Perrot resembled Henry VIII in temperament and physical appearance, and it was widely believed that he was the bastard son of the late King. The main source for this belief was Sir Robert Naunton (husband of Perrot's granddaughter, Penelope), who had never known Perrot and used second-hand accounts to make his case. The case is weakened by the fact that Perrot was Mary Berkeley's third child, not her first, and that she and the King are not recorded to have been in the same place at the crucial time. Naunton claimed that Sir Owen Hopton, Lieutenant of the Tower of London, overheard Perrot say, ""Will the Queen suffer her brother to be offered up as a sacrifice to the envy of his frisking adversaries?"", suggesting that Perrot himself asserted his royal paternity. However, Hopton had been removed from office by the Queen eighteen months prior to Perrot's imprisonment, so he could not have overheard Perrot make the claim there.