The people in the domain held a grudge against Tadakuni well into later years, because a part of the Karatsu Domain was taken away by bakufu as a shogunal demesne, and they suspected that this was used as a bribe to realize the domain transfer, and they also suffered a harsh tax collection in the demesne.
また唐津藩から一部天領に召し上げられた地域があり、地元民には国替えの工作のための賄賂として使われたのではないかという疑念と、天領の年貢の取立てが厳しかったことから、後年まで恨まれている。