Garnet spent much of 1604 on the move, although few details of his travels exist. At Easter he reportedly gave a mass at Twigmoor Hall, the house of John Wright. In November he was with Anne Vaux (whose family he had been introduced to in summer 1586) at White Webbs near Enfield, renewing the vows given on the Feast of the Presentation of Our Lady. On 9 June 1605, he was to be found in a room on Thames Street in London, with Robert Catesby. In the midst of what Garnet later recalled was a seemingly casual conversation, Catesby asked the priest about the morality of "killing innocents". Garnet replied according to Catholic theology, that often, during war, innocents were killed alongside the enemy. According to Antonia Fraser, Garnet may have thought that Catesby's request was to do with him possibly raising a regiment in Flanders.