title: How to get all the URLs of a website using Crawling process with Asp.net?
body: <p>How to get all the URLs of a website </p>
  
  <p>Suppose I want to crawl some part of data in a website which in different web pages how to get all the url's list to get into all those similar pages.</p>
  
  <p>suppose in a mobiles website I want to get all mobiles of one brand how can I get them which are in different URL's of the site. I observe the Div tag class is "brand name" for all the mobiles</p>
  
  <p>Div Class"Nokia" .... I want the URLs of the website which have div class as nokia.  </p>