Rolfe was entirely comfortable with his homosexuality and associated and corresponded with a number of other homosexual Englishmen. Early in his life he wrote a fair amount of idealistic but mawkish poetry about boy martyrs and the like. These and his Toto stories contain pederastic elements, but the young male pupils he was teaching at the time unanimously recalled in later life that there had never been any hint of impropriety in his relations with them. As he himself matured, Rolfe's settled sexual preference was for late adolescents. Towards the end of his life he made his only explicit reference to his specific sexual age preference, in one of the Venice letters to Charles Masson Fox, in which he declared: "My preference was for the 16, 17, 18 and large." Grant Richards, in his "Memories of a Misspent Youth" (1932), recalls "Frederick Baron Corvo" at Parson's Pleasure in Oxford – where scholars could bathe naked – "surveying the yellow flesh tints of youth with unbecoming satisfaction".