The relationship between the brothers began to sour, however, because while Emperor Xiaozhao had promised Gao Zhan that he would be made crown prince, soon created his own son Gao Bainian crown prince instead. In 561, Emperor Xiaozhao tried to transfer some of Gao Zhan's authorities at Yecheng to Hulü Jin's son Hulü Xian (斛律羨), but Gao Zhan refused to transfer that authority. Meanwhile, sorcerers informed Emperor Xiaozhao that the imperial aura was still at Yecheng, making Emperor Xiaozhao concerned. Gao Guiyan, who was concerned that Gao Yin would one day take the throne again and retaliate against him, persuaded Emperor Xiaozhao that his nephew had to be removed, and so Emperor Xiaozhao issued an edict to summon the Prince of Ji'nan to Jinyang. Gao Zhan, was disappointed at Emperor Xiaozhao not created him crown prince, briefly considered redeclaring Gao Yin emperor and starting a rebellion against Emperor Xiaozhao, but ultimately chose not to do it, as his own sorcerers informed him that they believed that he would become emperor one day anyway. He therefore sent Gao Yin to Jinyang, and soon, Emperor Xiaozhao had Gao Yin killed.