title: t.xpath not getting results from second page?
body: <p>I am trying to iterate over multiple pages of a website, however the code I am using below is only returning the results from the first page, even though I am using Selenium to click to the next page. I am at a loss for what could be causing this. Any explanation would be much appreciated! </p>
  
  <p>The website in question:
  <a href="https://www.cruiseplum.com/search#%7B%22numPax%22:2,%22geo%22:%22US%22,%22portsMatchAll%22:true,%22numOptionsShown%22:100,%22ppdIncludesTaxTips%22:true,%22uiVersion%22:%22split%22,%22sortTableByField%22:%22dd%22,%22sortTableOrderDesc%22:false,%22filter%22:null%7D" rel="nofollow noreferrer">https://www.cruiseplum.com/search#{%22numPax%22:2,%22geo%22:%22US%22,%22portsMatchAll%22:true,%22numOptionsShown%22:100,%22ppdIncludesTaxTips%22:true,%22uiVersion%22:%22split%22,%22sortTableByField%22:%22dd%22,%22sortTableOrderDesc%22:false,%22filter%22:null}</a></p>
  
  <pre><code>from selenium import webdriver
  import time
  import xlsxwriter
  from lxml import html
  
  u = 'https://www.cruiseplum.com/search#{%22numPax%22:2,%22geo%22:%22US%22,%22portsMatchAll%22:true,%22numOptionsShown%22:100,%22ppdIncludesTaxTips%22:true,%22uiVersion%22:%22split%22,%22sortTableByField%22:%22dd%22,%22sortTableOrderDesc%22:false,%22filter%22:null}'
  driver = webdriver.Chrome()
  driver.get(u)
  driver.maximize_window()
  
  time.sleep(.3)
  
  driver.find_element_by_id('restoreSettingsYesEncl').click() # select 'yes' on the webpage to restore settings
  time.sleep(7) # wait until the website downloads data so we get a return value
  
  elem = driver.find_element_by_xpath("//*")
  source_code = elem.get_attribute("innerHTML")
  
  t = html.fromstring(source_code)
  
  for i in range(5):
  
      for i in t.xpath('.//td[@class="dc-table-column _0"]/text()'):
          print(i.strip())
  
      driver.find_element_by_xpath('//*[@id="listings-table-split"]/div[5]/div/span[4]').click() # click to next page
      time.sleep(.05)
  
  driver.quit()
  </code></pre>