In summer 655, Consort Wu accused Empress Wang and Lady Liu of using witchcraft to try to gain favor back for Empress Wang, and in response, Emperor Gaozong barred Lady Liu from the palace and exiled Liu Shi. Despite this, he did not immediately depose Empress Wang. In fall 655, he summoned the chancellors Zhangsun, Chu Suiliang, Li Ji, and Yu Zhining to the palace to discuss the matter—a meeting that Li Ji declined to attend. Chu fervently opposed deposing Empress Wang and pointed out that Consort Wu was previously Emperor Taizong's concubine and, therefore, taking her was considered incest. Two other chancellors not invited to the meeting, Han Yuan and Lai Ji, also submitted opposition. However, after Emperor Gaozong asked Li Ji for his opinion, Li Ji responded, "This is your family matter, Your Imperial Majesty. Why ask anyone else?" Emperor Gaozong thus became resolved to depose Empress Wang, and in winter 655—November 16—both Empress Wang and Consort Xiao were deposed and reduced to commoner rank. Their mothers and brothers were exiled to the modern Guangdong region, while Empress Wang's father Wang Renyou's posthumous honors were stripped.