But Naomasa died in 1602 before construction had even begun, and so his heir Naokatsu II took over the construction plans, recycling many of the building materials used in Sawayama-jo Castle in order to complete construction of Hikone-jo Castle.
しかし、直政は築城に着手できないまま1602年（慶長7年）に死去したため、嫡子の井伊直勝がその計画を継ぎ、佐和山城などの築材を利用して建造した彦根城が完成した。