The best source I have seen is Peter Brown, The Body and Society: Men, Women, and Sexual Renunciation in Early Christianity (New York: Columbia University Press,1998). It covers the history from Paul to Augustine and is quite readable.