Why? Because it was common for priests to be followed in their positions by their sons. After a few generations, it became difficult to distinguish between property belonging to the church and property belonging to the priest.

Besides, sex is nasty. If a priest is holy, he should not defile (and that is the correct word) himself with sexual intercourse. The Wikipedia article on Clerical celibacy has plenty of quotes.