title: JSOUP / HTTP error fetching URL. Status=503
body: <p>I am using JSOUB  to scrape all the web page as the following:</p>
  
  <pre><code>   public static final String GOOGLE_SEARCH_URL = "https://www.google.com/search";
  
     String searchURL = GOOGLE_SEARCH_URL + "?q="+searchTerm+"&amp;num="+num + 
        "&amp;start=" + start;
  
  
      Document doc = Jsoup.connect(searchURL)
              .userAgent("Mozilla/5.0 Chrome/26.0.1410.64 Safari/537.31")
             // .ignoreHttpErrors(true)
              .maxBodySize(1024*1024*3) 
              .followRedirects(true)
              .timeout(100000)
              .ignoreContentType(true)
              .get();
  
  
      Elements results = doc.select("h3.r &gt; a");
  
        for (Element result : results) {
  
          String linkHref = result.attr("href");
       }
  </code></pre>
  
  <p>But my problem is that at the start of the code working good.</p>
  
  <p>after a while, it will stop and always gives me " HTTP error fetching URL. Status=503  error".</p>
  
  <p>when I add the .ignoreHttpErrors(true) it will work without any error but it will not scrape the web.</p>
  
  <p>*search term is any keyword I want to search about and num is the number of pages that I need to retrieve.</p>
  
  <p>could anyone help, please?
  Is this mean that Google blocked my IP from scraping? if yes is there any solution or how I scape the google search result, please?</p>
  
  <p>I need help.
  Thank you,</p>