title: How can I get html content written by JavaScript with Selenium/Python
body: <p>I'm doing web-crawling with Selenium and I want to get an element(such as a link) written by JavaScript after Selenium simulating clicking on a fake link.</p>
  
  <p>I tried get_html_source(), but it doesn't include the content written by JavaScript.</p>
  
  <p>Code I've written:</p>
  
  <pre><code>    def test_comment_url_fetch(self):
          sel = self.selenium 
          sel.open("/rmrb")
          url = sel.get_location()
          #print url
          if url.startswith('http://login'):
              sel.open("/rmrb")
          i = 1
          while True:
              try:
                  if i == 1:
                      sel.click("//div[@class='WB_feed_type SW_fun S_line2']/div/div/div[3]/div/a[4]") 
                      print "click"
                  else:
                      XPath = "//div[@class='WB_feed_type SW_fun S_line2'][%d]/div/div/div[3]/div/a[4]"%i
                      sel.click(XPath)
                      print "click"
              except Exception, e:
                  print e
                  break
              i += 1
          html = sel.get_html_source()
          html_file = open("tmp\\foo.html", 'w')
          html_file.write(html.encode('utf-8'))
          html_file.close()
  </code></pre>
  
  <p>I use a while-loop to click a series of fake links which trigger js-actions to show extra content, and that content is what I want. But sel.get_html_source() didn't give what I want.</p>
  
  <p>Anybody may help? Thanks a lot.</p>