Although some repairs were carried out, without a community to support it, the temple fell into disrepair. A cyclone in 1956 blew away the pagoda, which was replaced by a lean-to. Damage also occurred from water leakage. In the 1960s artefacts were removed from the temple, including the image of Hou Wang and other gods. Some of these artefacts have since been returned. The temple was used intermittently for worship until the early 1970s and contains objects connected with this later use. The land on which the temple stands was purchased in 1965 by several local Chinese families.