title: My web scraper is not scraping all the comments and usernames
body: <p>I wrote a code to scrape all the comments and usernames on a reddit post but the code isn't scraping everything,</p>
  <p>What might be the problem?</p>
  <p>Here is my code:</p>
  <pre><code>import requests
  from bs4 import BeautifulSoup
  
  listt = []
  count = 0
  username_list = []
  comment_list = []
  
  headers = {&quot;User-Agent&quot;: &quot;Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.110 Safari/537.36&quot;}
  url = input(&quot;Please input reddit url:&quot;)
  page = requests.get(url, headers=headers)
  
  old_page_url = &quot;https://old&quot;+url[11:]
  old_page = requests.get(old_page_url,headers=headers)
  
  
  soup = BeautifulSoup(page.text,&quot;html.parser&quot;)
  old_soup = BeautifulSoup(old_page.text,&quot;html.parser&quot;)
  
  comments = soup.findAll('div',{'data-test-id':'comment'})
  
  for one_comment in comments:
      comment_list.append(one_comment.text)
  
  for name in old_soup.find_all(&quot;a&quot;):
      listt.append(name.text)
  
  
  for item in listt:
      if item == '[–]':
          username_list.append(listt[count+1])
      count+=1
  
  
  for i in range(len((comment_list))):
      print(f&quot;Comment made by u/{username_list[i]} = {comment_list[i]}&quot;)
  </code></pre>