According to "Gukansho," Yoshitomo immediately left the Dairi for Rokuhara; however, it is not certain that there were in fact any battles at the Dairi, and therefore, this could be an embellishment to make the story more thrilling.
もっとも『愚管抄』によれば義朝はすぐに内裏を出撃して六波羅に迫ったとあるので、内裏で戦闘が行われたかどうかは定かでなく、話を盛り上げるための創作の可能性もある。