Soil erosion
Erosion also leaves large sinkholes in the ground, which can weaken buildings and even cause them to collapse.   Urban areas are usually protected from soil erosion, so not many buildings collapse from erosion.