title: scraping google news headlines
body: <p>Google news is searchable by keyword and then that search can be narrowed down to a certain time period.</p>
  
  <p>I tried doing the search on the website and then using the url of the results page to reverse engineer the search in python thus:</p>
  
  <pre><code>import urllib2
  
  
  url = 'https://www.google.com/search?hl=en&amp;gl=uk&amp;tbm=nws&amp;authuser=0&amp;q=apple&amp;oq=apple&amp;gs_l=news-cc.3..43j0l9j43i53.5710.6848.0.7058.5.4.0.1.1.0.66.230.4.4.0...0.0...1ac.1.SRcIeXL5d48'
  
  handler = urllib2.urlopen(url)
  html = handler.read()
  </code></pre>
  
  <p>however, i get a 403 error. This method works with other websites, such as bbc.co.uk. so obviously google does not want me to scrape the website with python.</p>
  
  <p>so i have two questions: 
  1) is it possible to bypass this restriction google has placed? if so, how?
  2) are there any other scrapeable news sites where i can search for news on a keyword for a given period.</p>
  
  <p>for either of the options, i don't mind using a paid service. so such suggestions are welcome too.</p>
  
  <p>thanks in advance,
  K.</p>