title: Scraping multiple pages from Amazon
body: <p>I'm trying to scrape the data of the books from amazon, but I can't fetch the data after the first page.</p>
  <pre><code>from requests_html import HTMLSession 
  import pandas as pd
  s=HTMLSession()
  url=&quot;https://www.amazon.com.tr/s?i=stripbooks&amp;rh=n%3A13808201031&amp;fs=true&amp;qid=1646844141&amp;ref=sr_pg_1&quot;
  def getdata(url):
      r=s.get(url)
      html_str = r.text
      r.html.render(sleep=1)
      soup=BeautifulSoup(r.html.html,&quot;html.parser&quot;)
      return soup
  def getnextpage(soup):
      page=soup.find(&quot;span&quot;,{&quot;class&quot;:&quot;s-pagination-strip&quot;})
      if not page.find(&quot;span&quot;,{&quot;class&quot;:&quot;s-pagination-item s-pagination-next s-pagination-disabled&quot;}):
          url=&quot;http://www.amazon.com.tr&quot;+ str(page.find(&quot;span&quot;,{&quot;class&quot;:&quot;s-pagination-item s-pagination-next s-pagination-button s-pagination-separator&quot;}).find(&quot;a&quot;)[&quot;href&quot;])
          return url
      else:
          return
  while True:    
      soup=getdata(url)
      print(getnextpage(soup))
      if not url:
          break
      print(url)
  </code></pre>
  <p>And this is the error I got:</p>
  <pre><code>AttributeError: 'NoneType' object has no attribute 'find'
  </code></pre>
  <p>What could be the reason? Am I using the wrong classes?</p>