title: Get full HTML for page with dynamic expanded containers with python
body: <p>I am trying to pull the full HTML from ratemyprofessors.com however at the bottom of the page, there is a "Load More Ratings" button that allows you to see more comments.</p>
  
  <p>I am using requests.get(url) and beautifulsoup, but that only gives the first 20 comments. Is there a way to have the page load all the comments before it returns?</p>
  
  <p>Here is what I am currently doing that gives the top 20 comments, but not all of them.</p>
  
  <pre><code>    response = requests.get(url)
      soup = BeautifulSoup(response.text, "html.parser")
      comments = []
      for j in soup.findAll('div', attrs={'class': 'Comments__StyledComments-dzzyvm-0 dEfjGB'}):
          comments.append(j.text)
  </code></pre>