title: filter duplicate URLs domain from List c#
body: <p>I have a list of 100,000 urls in list(Of string) which can contain urls in the form.</p>
  
  <pre><code>yahoo.com
  http://yahoo.com
  http://www.yahoo.com
  </code></pre>
  
  <p>i have tried using a combination of regex and the Uri class, but that didn't help, so i dumped the code. i also tried using this code, but it will only remove duplicatse of exact form, since its not domain specific.</p>
  
  <pre><code>list = new ArrayList&lt;T&gt;(new HashSet&lt;T&gt;(list))
  </code></pre>
  
  <p>How filter these duplicates and keep just one of these url if it contains the same name e.g yahoo.</p>
  
  <p>thanks</p>
  
  <p>[EDIT]</p>
  
  <p>Please note that</p>
  
  <p>all URL are of different domains, but can usually have duplicates like the example i gave above</p>
  
  <p>also, am using .net 2.0, so i can't use linq</p>