title: Encoding issues using selenium page_source
body: <p>I have been trying to get data from the Apple Store top 1000. I have been using the following code:</p>
  
  <pre><code>from selenium import webdriver
  from bs4 import BeautifulSoup
  import json
  
  profile = webdriver.FirefoxProfile()
  #Create a profile that makes my browser act like I am browsing from an iPad.
  profile.set_preference("general.useragent.override", "iTunes-iPad/5.1.1 (64GB; dt:28)")
  driver = webdriver.Firefox(profile)
  
  driver.get('https://itunes.apple.com/WebObjects/MZStore.woa/wa/topChartFragmentData?cc=cn&amp;genreId=6014&amp;pageSize=5&amp;popId=38&amp;pageNumbers=0')
  
  soup = BeautifulSoup((driver.page_source).encode('utf-16'))
  
  dict_from_json = json.loads(soup.find("body").text)
  
  print(dict_from_json)
  </code></pre>
  
  <p>For some reason, the Firefox Webdriver opens this page in a 'Western' encoding (this is shown under 'text encoding' in the 'view' drop down box). </p>
  
  <p>This makes some foreign stores (i.e. China/Japan) all scrambled with things like '½æ°‘æ‰‹æ¸¸ äººäººéƒ½çŽ©'. If I change this encoding to the Unicode option it is all fine.</p>
  
  <p>I have not been able to find a way to convince Firefox to open this page with this unicode 'view' through Selenium. Furthermore, my script, where I force the page source to be encoded as utf-8, also still gives the same weird characters.</p>
  
  <p>I am currently a bit at a loss on how I get the characters in the way that I want to see them.</p>
  
  <p>Thanks for any help you can give me!</p>