title: using beautiful soup for simulating a page-click to access all HTML on a page?
body: <p>I'm trying to scrape the following website:</p>
  
  <p><a href="https://www.bandsintown.com/?came_from=257&amp;sort_by_filter=Number+of+RSVPs" rel="nofollow noreferrer">https://www.bandsintown.com/?came_from=257&amp;sort_by_filter=Number+of+RSVPs</a></p>
  
  <p>I'm able to successfully scrape the events listed on the page using beautifulsoup, using the following code:</p>
  
  <pre><code>from bs4 import BeautifulSoup
  import requests
  url = 'https://www.bandsintown.com/?came_from=257&amp;sort_by_filter=Number+of+RSVPs'
  response = requests.get(url)
  soup = BeautifulSoup(response.text, 'html.parser')
  
  
  dates = soup.find_all('div', {'class': 'event-b58f7990'})
  month=[]
  day=[]
  for i in dates:
      md = i.find_all('div')
      month.append(md[0].text)
      day.append(md[1].text)
  </code></pre>
  
  <p>However, the issue I'm having is that I'm only able to scrape the first 18 events - the rest of the page is only available if the 'view all' button is clicked at the bottom.  Is there a way in beautifulsoup, or otherwise, to simulate this button being clicked, so that I can scrape ALL of the data?  I'd prefer to keep this in python as I'm doing most scraping with beautifulsoup.  Thanks so much!</p>