title: Python - BeautifulSoup fails to web-scrape bloomberg info upon frequent requests
body: <p>I was trying to use BeautifulSoup to get the sector, industry and sub-industry from Bloomberg using the codes below:</p>
  <pre><code>import requests
  from bs4 import BeautifulSoup
  from fake_useragent import UserAgent
  
  headers = {'User-Agent': 'Mozilla/80.0'}
  
  response = requests.get('https://www.bloomberg.com/profile/company/VRTU:US', headers = headers)
  content = response.content
  parser = BeautifulSoup(content, 'html.parser')
  
  sector = parser.findAll('div', class_ = 'infoTableItemValue__e188b0cb')[1].text
  industry = parser.findAll('div', class_ = 'infoTableItemValue__e188b0cb')[1].text
  sub_industry = parser.findAll('div', class_ = 'infoTableItemValue__e188b0cb')[2].text
  </code></pre>
  <p>The codes run fine only for a single stock extraction. But when I made it into a loop to extract a list of stocks, Bloomberg will block my IP and returned to blocked content.</p>
  <blockquote>
  Bloomberg - Are you a robot?  
  <p>..............</p>
  
      document.getElementById("block_uuid").innerText = "Block reference ID: " + window._pxUuid;
      
  </blockquote>
  <p>Even if I used fake_useragent, Bloomberg blocked my IP either. Is there anything I can dodge to do the extraction of a list of stocks from Bloomberg?</p>