In the 2013–14 season, Williams suffered a knee injury in a pre-season friendly, but made his recovery soon after. Weeks later on 27 August 2013, Williams was the hero in the penalty shoot-out against Bolton Wanderers in the second round of League Cup after saving two penalties from André Moritz and Alex Baptiste following a 1–1 draw that last through 120 minutes. By the first half of the season, Williams made twenty-one out of twenty-three appearance because of his international commitment. Despite this, Williams' continued to impress and was nominated for Sky Bet League 1 Player of the Month award for February as a result of his good performance. However, the club find themselves in the relegation zone, with their League One status for next season was under threat. After being booked in a match against Leyton Orient on 26 April 2014, Williams missed the match on the final day of the season a home defeat against Bradford City and results elsewhere meant they were relegated to League Two. Following the club's relegation, Williams' relegation clause was activated, allowing him to leave the club.