In the ancient time the village was inhabited by Buddhist people.
This sentence describes a historical fact about the village's inhabitants. It implies that Buddhism was a significant part of life in the village at some point in the past.