title: Web scraper that handles JavaScript
body: <blockquote>
    <p><strong>Possible Duplicate:</strong><br>
    <a href="https://stackoverflow.com/questions/8326301/make-a-javascript-aware-crawler">Make a JavaScript-aware Crawler</a>  </p>
  </blockquote>
  
  
  
  <p>I'm trying to figure out what to use as the basis for a PHP based web scraper that can handle pages that render using JavaScript. Many web site scrape attempts (at least the ones I handle) now fail unless the JS in those pages is executed. The pages are not built to gracefully fall back to no-script implementations. This includes those that make heavy use of AJAX.</p>
  
  <p>Would anyone have suggestions for where to start with the development of a web scraper that can handle modern and heavily JavaScript dependent web pages?</p>
  
  <p>Something that can be used by PHP would be best.</p>