title: Twitter scraping in Python
body: <p>I have to scrape tweets from Twitter for a specific user (@salvinimi), from January 2018. The issue is that there are a lot of tweets in this range of time, and so I am not able to scrape all the ones I need!
  I tried multiple solutions:</p>
  <h1>1)</h1>
  <pre><code>pip install twitterscraper
  from twitterscraper import query_tweets_from_user as qtfu
  tweets = qtfu(user='matteosalvinimi')
  </code></pre>
  <p>With this method, I get only a few teets (500~600 more or less), instead of all the tweets... Do you know why?</p>
  <h1>2)</h1>
  <pre><code>!pip install twitter_scraper
  from twitter_scraper import get_tweets
  tweets = []
  for i in get_tweets('matteosalvinimi', pages=100):
      tweets.append(i)
  </code></pre>
  <p>With this method I get an error -&gt; &quot;ParserError: Document is empty&quot;...
  If I set &quot;pages=40&quot;, I get the tweets without errors, but not all the ones. Do you know why?</p>