In a large domain, however, there were various ranks of retainers between the chief retainer and the yojin, such as toshiyori and churo, who supported the chief retainer, thus reducing the importance of the yojin's role to only general administrative matters and special issues, and at times reducing its rank lower than the bangashira.
他方、大きな藩では、家老と用人の中間に年寄・中老をはじめ、さまざまな家老を補佐する役職があるので、用人の役目は相対的に低くなり、特命事項や庶務的なものとなるので、用人は番頭より格下となることもある。