Residences of fudai daimyo (hereditary vassals to the Tokugawa clan) were built on the western outskirts of the interior castle moat between the Oote-mon and Wadakura-mon gates, an area south of the Sakurada-mon gate was designated the residence of the tozama daimyo (nonhereditary feudal lord), and Hatamoto and Gokenin (shogunal retainers) were housed on a hillside stretching between the outskirts of the western Hanzo-mon gate to Hitotsubashi-mon and Kandabashi-mon gates; choninchi (residential and commercial areas for townspeople) the reclaimed lands in Hibiya stretched between Tokiwa-bashi Bridge, Gofuku-bashi Bridge, Kaji-bashi Bridge, Sukiya-bashi Bridge, Sumida-gawa River and the Edo Bay.
内城の堀の外は東の大手門下から和田倉門外に譜代大名の屋敷、南の桜田門の外に外様大名の屋敷と定められ、西の半蔵門外から一ツ橋門、神田橋門外に至る台地に旗本・御家人が住まわされ、さらに武家屋敷地や大名屋敷地の東、常盤橋・呉服橋・鍛冶橋・数寄屋橋から隅田川、江戸湾に至るまでの日比谷埋立地方面に町人地が広げられた。