Two years later, he could no longer tolerate any association with Jews, including the thoroughly assimilated Halevys.
He doesn't want to be associated with Jews anymore, even with the Halevys.
He enjoys being associated with Jews, most especially with the Halevys.