title: Scripted Browser Scapper
body: <p>What can I use to achieve the following, script a browser or otherwise make a request to the server, login, browse the site, eg. find links and navigate to those links. </p>
  
  <p>For now, since I am into NodeJS, I was looking at node.io. It allows you to scrape site quite easily but problem is when I try to post (to login) I get nothing back! </p>
  
  <pre><code>nodeio = require "node.io"
  
  nodeio.scrape -&gt;
  
      @post "http://localhost/auth/login", {
          username: "username"
          password: "password"
      }, -&gt;
  
          console.log "=====After Login====="
  </code></pre>
  
  <p>But I just get </p>
  
  <pre><code>OK: Job complete
  </code></pre>
  
  <p>Even if the login fails, I should get to after login <code>console.log</code>?</p>
  
  <hr>
  
  <p>Then I was thinking maybe its better to implement this by scripting a browser instead, it will simulate more closely a real request?</p>