title: Goutte, how can the site see i am a robot?
body: <p>It doesn't matter whether I use Firefox or GoogleBot, the site still sees me as a bot.</p>
  
  <p>I am trying to create a crawler using Goutte. The website have a blocking system for crawlers, but I can't figure out how to avoid it. This is my current code:</p>
  
  <pre><code>require_once 'includes/goutte.phar';
  use Goutte\Client;
  $client = new Client();
  $client-&gt;setHeader('User-Agent', "Googlebot");
  $crawler = $client-&gt;request('GET', 'http://www.example.com');
  echo $crawler-&gt;filter('')-&gt;text();
  </code></pre>
  
  <p>As you can see I have changed the user-agent, and I have tested that it is changed correctly by crawling a local file, that logged the user agents.</p>
  
  <p>Still the site somehow recognize me as a bot. Any ideas?</p>