title: request.get() not getting entire dom
body: <p>I'm scraping a website, but some products don't appear in the DOM unless you scroll down. For instance take a look at <a href="https://www.project6ny.com/collections/all-childrens-accessories#" rel="nofollow">this page</a>.</p>
  
  <p>When I store the DOM inside a variable and try to get the divs corresponding to the products:</p>
  
  <pre><code>req = requests.get(*url*,verify=False)
  soup = BeautifulSoup(req.text,'html.parser')
  product_list = soup.findAll("div",class_="product-block")
  </code></pre>
  
  <p>product_list only contains 24 elements (instead of 91, the number of products in that page if you scroll down completely). 
  How can I store the complete DOM inside <code>req</code>?</p>
  
  <p>NB.
  I'm not sure if that is the reason for the products non appearing in product_list, but this is the interpretation I give since, when I inspect the DOM with firefox, if I don't scroll down, I only see 24 <code>&lt;div class="product-block ..."&gt;</code>, not 91.</p>