This was not an issue between him and his wife. 

"The Duggars, whose family stars in TLC’s popular reality show “19 Kids and Counting,” spoke about the _multiple incidents of molestation_ that occurred in their Arkansas home. According to Jim Bob and Michelle, the victims included four of their daughters, along with a family babysitter." https://www.washingtonpost.com/news/acts-of-faith/wp/2015/06/03/what-to-expect-from-the-fox-news-interview-with-josh-duggars-parents/?utm_term=.3735efcbfb9b