Although he transferred the headship of the family to his fifth son, Takamasu and went into retirement on December 11, 1832, Takamasu died soon after the succession and as one misfortune followed another, his seventh son, Takatsune, soon after succeeding to Takamasu, also predeceased his father Takamasa.
天保3年（1832年）11月20日、家督を五男・高倍に譲って隠居したが、その高倍とさらにその後を継いだ息子の京極高鎮がわずかな間に自身に先立って次々と早世した。