title: Scraping subreddit top posts of all time using requests is returning the wrong result
body: <p>I would like to scrape a subreddit for their top posts of <strong>all time</strong>. I know there is a <code>PRAW</code> module that may work better, but I would prefer to scrape using <code>requests</code> only for now.</p>
  <pre><code>import requests
  
  url = &quot;https://www.reddit.com/r/shittysuperpowers/top/?t=all.html&quot;
  headers = {&quot;User-agent&quot;: &quot;bot_0.1&quot;}
  res = requests.get(url, headers=headers)
  </code></pre>
  <p><code>res.status_code</code> returned a 200, and the scrape was successful. But closer inspection of <code>res.text</code> revealed that the data html scraped is not from the desired page. In fact, what was scraped were from the top posts <strong>today</strong> rather than of all time, or from this url <code>https://www.reddit.com/r/shittysuperpowers/top/?t=day.html</code>. Is there any reason why I am unable to scrape the top posts of all time? I have tried this with other subreddits too and they all run into the same problem.</p>