title: How can I bring google-like recrawling in my application(web or console)
body: <p>How can I bring google-like recrawling in my application(web or console). I need only those pages to be recrawled which are updated after a particular date.</p>
  
  <p>The LastModified header in the System.Net.WebResponse gives only the current date of the server. For example if I downloaded one page with HTTPWebRequest on 27 January 2012, and check the header for the LastModified date, it is showing the current time of the server when the page was served. In this case it is 27 January 2012 only.</p>
  
  <p>Can anyone suggest any other methods?</p>