title: urllib2 read to Unicode
body: <p>I need to store the content of a site that can be in any language. And I need to be able to search the content for a Unicode string.</p>
  
  <p>I have tried something like:</p>
  
  <pre><code>import urllib2
  
  req = urllib2.urlopen('http://lenta.ru')
  content = req.read()
  </code></pre>
  
  <p>The content is a byte stream, so I can search it for a Unicode string.</p>
  
  <p>I need some way that when I do <code>urlopen</code> and then read to use the charset from the headers to decode the content and encode it into UTF-8.</p>