그러나 1868년 흥선대원군의 서원철폐령으로 폐쇄되자 공자의 영정은 강릉 향교로 옮겼고 주자와 송시열의 영정은 연천 임장서원으로 옮겼다.
However, when it was closed in 1868 due to the abolition act of lecturing halls by Crown Prince Heungseon Daewongun, Confucius' portrait was moved to Gangneung Hyanggyo, and the portrait of Juja and Song Siyeol was moved to Yeoncheon Imjangseowon.