Said to have been constructed in 521 and was previous named Oi-sha Shrine after the harai-gami of Oi-gawa River (Katsura-gawa River (Yodo-gawa River system)) but was renamed Ayato-sha Shrine in the year 995.
継体天皇15年の創建と伝えられ、かつては大井川（桂川(淀川水系)）の祓神として大井社と称していたが、天暦9年（955年）に綾戸社に改称した。