it was also widely rumored that jefferson had a very many sexual relations with his slaves , and fathered many children with them which meant that he had enslaved his children -- further actions of which the jeffersonian elites approved .