The family lived in the Cannon Sandbar in Edo and moved to Higo, Takase (Tamana City, Kumamoto Prefecture) in the end of Edo period, therefore they are also called as the Takase clan.
江戸鉄砲洲に住み、幕末に肥後高瀬（熊本県玉名市）に移ったため高瀬藩とも言う。