title: how to scrape website in which page url is not changed but the next button add data below the same url page
body: <p>I have a URL:</p>
  
  <pre><code>http://www.goudengids.be/qn/business/advanced/where/Provincie%20Antwerpen/what/restaurant
  </code></pre>
  
  <p>On that page there is a "next results" button which loads another 20 data point while still showing first dataset, without updating the URL. I wrote a script to scrape this page in python but it only scrapes the first 22 data point even though the  "next results" button is clicked and shows about 40 data. </p>
  
  <p>How can I scrape these types of website that dynamically load content</p>
  
  <p>My script is </p>
  
  <pre><code>import csv
  import requests
  from bs4 import BeautifulSoup
  
  
  url = "http://www.goudengids.be/qn/business/advanced/where/Provincie%20Antwerpen/what/restaurant/"
  r = requests.get(url)
  r.content
  
  soup = BeautifulSoup(r.content)
  print (soup.prettify())
  
  g_data2 = soup.find_all("a", {"class": "heading"})
  for item in g_data2:
      try:
          name = item.text
          print name
      except IndexError:
          name = ''
          print "No Name found!"
  </code></pre>