title: Python Selenium WebDriver JavaScript Table Iteration
body: <p>I've been playing with Beautiful Soup for awhile and it works great minus the javascript limitations. I am trying to use Selenium to bridge the gap in my toolbox. The site I am trying to scrape is <a href="http://www.5dimes.eu/livelines/livelines.aspx" rel="nofollow noreferrer">http://www.5dimes.eu/livelines/livelines.aspx</a></p>
  
  <p>**I should mentioned I am in windows and can't get QTWebKit to work which I've been told is an option as well.</p>
  
  <p>The site requires you to click a checkbox in order for the table(s) to preview. Once I was able to get the table to preview, I assumed I was in the clear but alas no.</p>
  
  <p>I tried to use </p>
  
  <pre><code>driver = webdriver.Chrome()
  page = driver.get("http://www.5dimes.eu/livelines/livelines.aspx")
  driver.find_element_by_xpath("//*[@id='l_26']").click()
  html_source = driver.page_source
  </code></pre>
  
  <p>and was able to get the page to in fact click a link but the html_source didn't have the table data.</p>
  
  <p>Several issues followed on testing.</p>
  
  <ol>
  <li><p>The xpath id changes daily based on how many things are posted. One day it was 26 the next day it was 27 etc. Is there an alternate way to navigate to this checkbox either via class or text name?</p></li>
  <li><p>Once the table is displayed, how can I extract this data?</p></li>
  </ol>
  
  <p>I noticed in the class info that it mentioned a "hidden" attribute</p>
  
  <pre><code>&lt;div id="divLoading" style="width: 100%; text-align: center;" class="Hidden"&gt;
          &lt;img id="imgLoading" src="images/scanning.gif"&gt;
      &lt;/div&gt;
  </code></pre>
  
  <p>Could that be the source of the issue? Any help would be greatly appreciated</p>