The reason this story about an affair between Yoshitsune and Kenreimonin appeared is due to it being mentioned in 'Genpei Seisuiki' (The Rise and Decline of the Minamoto and Taira Clans).
なお、義経と建礼門院が通じるという話自体は「源平盛衰記」以来見られた。