title: Python Selenium Webdriver: Unable to load all reviews on the browser
body: <p>I am trying to extract all google reviews of a restaurant. There are just over 900 reviews of the restaurant. However, my script was only able to extract 50 reviews. I am not sure where am I making the mistake. Any help to fix the issue would be highly appreciated. Here is my code:</p>
  <pre><code>from selenium import webdriver
  from selenium.webdriver.common.by import By
  from selenium.webdriver.support.ui import WebDriverWait
  from selenium.webdriver.support import expected_conditions as EC
  from selenium.webdriver.chrome.options import Options
  from selenium.webdriver.common.action_chains import ActionChains
  import time
  
  driver = webdriver.Chrome()
  base_url = 'https://www.google.com/search?tbs=lf:1,lf_ui:9&amp;tbm=lcl&amp;sxsrf=AOaemvJFjYToqQmQGGnZUovsXC1CObNK1g:1633336974491&amp;q=10+famous+restaurants+in+Dunedin&amp;rflfq=1&amp;num=10&amp;sa=X&amp;ved=2ahUKEwiTsqaxrrDzAhXe4zgGHZPODcoQjGp6BAgKEGo&amp;biw=1280&amp;bih=557&amp;dpr=2#lrd=0xa82eac0dc8bdbb4b:0x4fc9070ad0f2ac70,1,,,&amp;rlfi=hd:;si:5749134142351780976,l,CiAxMCBmYW1vdXMgcmVzdGF1cmFudHMgaW4gRHVuZWRpbiJDUjEvZ2VvL3R5cGUvZXN0YWJsaXNobWVudF9wb2kvcG9wdWxhcl93aXRoX3RvdXJpc3Rz2gENCgcI5Q8QChgFEgIIFkiDlJ7y7YCAgAhaMhAAEAEQAhgCGAQiIDEwIGZhbW91cyByZXN0YXVyYW50cyBpbiBkdW5lZGluKgQIAxACkgESaXRhbGlhbl9yZXN0YXVyYW50mgEkQ2hkRFNVaE5NRzluUzBWSlEwRm5TVU56ZW5WaFVsOUJSUkFCqgEMEAEqCCIEZm9vZCgA,y,2qOYUvKQ1C8;mv:[[-45.8349553,170.6616387],[-45.9156414,170.4803685]]'
  driver.get(base_url)
  WebDriverWait(driver,10).until(EC.element_to_be_clickable((By.XPATH,&quot;//div[./span[text()='Newest']]&quot;))).click()
  
  title = driver.find_element_by_xpath(&quot;//div[@class='P5Bobd']&quot;).text
  address = driver.find_element_by_xpath(&quot;//div[@class='T6pBCe']&quot;).text
  overall_rating = driver.find_element_by_xpath(&quot;//div[@class='review-score-container']//span[@class='Aq14fc']&quot;).text
  total_reviews_text =driver.find_element_by_xpath(&quot;//div[@class='review-score-container']//div//div//span//span[@class='z5jxId']&quot;).text
   
  num_reviews = int (total_reviews_text.split()[0])
  all_reviews = WebDriverWait(driver, 3).until(EC.presence_of_all_elements_located((By.CSS_SELECTOR, 'div.gws-localreviews__google-review')))
  total_reviews = len(all_reviews)
  
  while total_reviews &lt; num_reviews:
          driver.execute_script('arguments[0].scrollIntoView(true);', all_reviews[-1])
          WebDriverWait(driver, 5, 0.25).until_not(EC.presence_of_element_located((By.CSS_SELECTOR, 'div[class$=&quot;activityIndicator&quot;]')))
          #all_reviews = driver.find_elements_by_css_selector('div.gws-localreviews__google-review')
          all_reviews = WebDriverWait(driver, 3).until(EC.presence_of_all_elements_located((By.CSS_SELECTOR, 'div.gws-localreviews__google-review')))
          print(total_reviews)
          total_reviews +=1
  </code></pre>