The mosque was originally built in 1950 at Roosevelt Road in Taipei. Because of the expansion of roads a few year later, the mosque was moved to Xinhai Road. It was reopened in 1983. The mosque was inaugurated by the Ambassador of Saudi Arabia to the ROC, Assad Abdul Aziz Al-Zuhair. The mosque was renovated on April 2010 with help from the Indonesian Economic and Trade Office to Taipei. 