title: How to parse website and get information
body: <p>I am trying to parse a website.This is what Im doing I download the source and traverse  the data using nokogiri and get the information I needed like links, content, etc. I already have the script for getting the data. But I stumbled a problem when the link only works when you click on it on a live site. </p>
  
  <p>This is the example source I'm trying to traverse.</p>
  
  <pre><code>&lt;div class="story-item-content group"&gt;
  &lt;div class="story-item-details"&gt;
    &lt;h3 class="story-item-title"&gt;
      &lt;a href="/story/r/how_not_to_fix_your_computer_part_2" target="_blank" class="external-link "&gt;How NOT to fix your computer, part 2.&lt;/a&gt;
      &lt;span class="external-link-icon"&gt;&lt;/span&gt;                                            
      &lt;/h3&gt;
      &lt;p class="story-item-description"&gt;
           &lt;a href="/search?q=site:zug.com" class="story-item-source" title="More stories from zug.com"&gt;zug.com&lt;/a&gt;                            &lt;a href="/news/technology/how_not_to_fix_your_computer_part_2" class="story-item-teaser"&gt;&amp;mdash; After you read this you should understand what not to do.
          &lt;span class="timestamp"&gt;21 hr 59 min ago&lt;/span&gt;&lt;/a&gt;
          &lt;a class="crawl4link" href="http://crawl4.digg.internal/permalink/view/how_not_to_fix_your_computer_part_2"&gt;View in Crawl 4&lt;/a&gt;
      &lt;/p&gt;
  &lt;/div&gt;
  </code></pre>
  
  <p>So in line 4. the link   href="/story/r/how_not_to_fix_your_computer_part_2 </p>
  
  <p>only works in a live site. When I download the source and click the link. It won't work. I'm guessing the link is save in the server. Any idea how do i get the full link?. I was thinking of having a script that clicks that link, in that way I can get the working link. Any idea how to do this? thnx</p>