Your relationship started as a mutual affair. Then he seemed to be having an affair within the affair. Expect to change him into a monogamous man is futile. Accept that you will have no more than an "open partnership" or leave.