The original building of the mosque was built in 1949 by the Nationalist Muslims whom mostly came with the Nationalist Army who fled from Mainland China after their defeat in the Chinese Civil War by the Communist Army. This wave of migration is considered to be the second wave of Muslim migration to Taiwan in the 1950s. The construction of the mosque was initially suggested by the Muslim public officers working for the Nationalist government.