title: How to find broken links on a website
body: <p>What techniques or tools are recommended for finding broken links on a website?</p>
  
  <p>I have access to the logfiles, so could conceivably parse these looking for 404 errors, but would like something automated which will follow (or attempt to follow) all links on a site.</p>