title: Going to the next page using Python 3 and BeautifulSoup 4
body: <p>I am trying to parse data from a tables on multiple pages of a web site using Python 3 and BeautifulSoup 4. Everything is working well except some of the pages have tables that exceed the length of the page. The page shows only 20 entries and to get the additional entries one would need to click the Next at the bottom of the table to move to the next page where the table data continues.
  I have tries using </p>
  
  <pre><code>nextPage = re.compile(b'Next&lt;/a&gt;')
  </code></pre>
  
  <p>and</p>
  
  <pre><code>nextPageUrl = nextPage.findall(webContent)
  </code></pre>
  
  <p>I know this is not BeautifulSoup. I tried this because I don't know how to do this using BeutifulSoup. However, it does not work. Can someone please help me and suggest how I can get the next page url to continue scraping? Thank you for any suggestions you may be able to provide.</p>