After his father Tadaaki retired due to a dispute with a chief retainer, Ito inherited the family estate but was expelled because it became known that he was in debt to Tadaaki.
家老との諍いにより父忠明が隠居した後、伊東が家督を相続したものの、後に忠明の借財が明るみになったことから追放される。