Williams was born on July 3, 1956 in Baltimore, Maryland. He has been married to Rochele See from 1982 until they divorced in 1989. Then he was married to Grace Morley from 1992 until they divorced in 2000. He is now married to Tara Fowler since 2007. With See, he has two children. Then with Morley he has two children.