However, a decade later, Empress Xu would meet her downfall. Circa 19 BC, when Emperor Cheng was visiting Princess Yang'a (陽阿公主), he became enamored with her dancing girl Zhao Feiyan (趙飛燕) and her sister Zhao Hede (趙合德) and made them his concubines, and they were favored over Empress Xu and Consort Ban. In 18 BC, the Zhao sisters falsely accused Empress Xu and Consort Ban of witchcraft; Empress Xu was deposed and put under house arrest in a subsidiary palace. Consort Ban was spared after successfully pleading her case, but she did not wish to return to the same environment and instead became a lady in waiting for Empress Dowager Wang.