When the children grew to adulthood and created their own identities and lives, Frank replaced them with his pets, new children “who never have to grow up”.
In this scenario, when the children became independent adults and forged their own paths, Frank replaced them with his pets, effectively creating a new family unit of "immortal" children.