title: How to get the full content from HttpWebResponse if the return content is Transfer-Encoding:chunked?
body: <p>I am writing a program to download html page from other website.
  I found a problem that for some particular website, I cannot get the full html code. And I only can get partial content.
  The server with this problem are sending data in "Transfer-Encoding:chunked" 
  I am afraid this is the reason of the problem.</p>
  
  <p><strong>This the header information returned by server:</strong></p>
  
  <pre class="lang-none prettyprint-override"><code>Transfer-Encoding: chunked
  Connection: keep-alive
  Pragma: no-cache
  Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
  Content-Type: text/html; charset=UTF-8
  Date: Sun, 11 Sep 2011 09:46:23 GMT
  Expires: Thu, 19 Nov 1981 08:52:00 GMT
  Server: nginx/1.0.6
  </code></pre>
  
  <p><strong>Here is my code:</strong></p>
  
  <pre><code>HttpWebRequest request = WebRequest.Create(url) as HttpWebRequest;
  HttpWebResponse response;
  CookieContainer cookie = new CookieContainer();
  request.CookieContainer = cookie;
  request.AllowAutoRedirect = true;
  request.KeepAlive = true;
  request.UserAgent =
      @"Mozilla/5.0 (Windows NT 6.1; rv:6.0.2) Gecko/20100101 Firefox/6.0.2 FirePHP/0.6";
  request.Accept = @"text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8";
  string html = string.Empty;
  response = request.GetResponse() as HttpWebResponse;
  
  using (StreamReader reader = new StreamReader(response.GetResponseStream()))
  {
      html = reader.ReadToEnd();
  }
  </code></pre>
  
  <p>I can only get partial html code ( I think it is the first chunk from the server). Could anyone help? Any Solution?</p>
  
  <p>Thanks!</p>