title: Unable to fetch some items using post request
body: <p>I've written a script in python to get the list of course materials from a website. To reveal the course materials it is necessary to fill in some <code>inputs</code> which can be found If you track the <code>Find Textbooks</code> link from it's landing page as it is visible in image one.</p>
  
  <p>However, when you fill in the inputs aaccordingly, the course materials will be revealed (the way I did it can be seen in image two).</p>
  
  <p>It seems, I did everything in the right way but could not fetch the items. When I execute my script, It doesn't parse anything, not throws any error either. The selectors I used within the script are supposed to be accurate.</p>
  
  <p><a href="https://uncg.bncollege.com/webapp/wcs/stores/servlet/BNCBHomePage?storeId=19069&amp;catalogId=10001&amp;langId=-1" rel="nofollow noreferrer">Link to the landing page</a></p>
  
  <p>This is my try so far:</p>
  
  <pre><code>import requests
  from bs4 import BeautifulSoup
  
  url = "https://uncg.bncollege.com/webapp/wcs/stores/servlet/BNCBTBListView"
  
  payload = {
      'storeId':'19069',
      'catalogId':'10001',
      'langId':'-1',
      'clearAll':'', 
      'viewName':'TBWizardView',
      'secCatList':'', 
      'removeSectionId':'', 
      'mcEnabled':'N',
      'showCampus':False,
      'selectTerm':'Select Term',
      'selectDepartment':'Select Department',
      'selectSection':'Select Section',
      'selectCourse':'Select Course',
      'campus1':'17548065',
      'firstTermName_17548065':'Fall 2018',
      'firstTermId_17548065':'84599238',
      'section_1': '85441456',
      'section_2':'', 
      'section_3':'',
      'section_4':'', 
      'numberOfCourseAlready':'4'
  }
  
  with requests.Session() as s:
      s.headers={"User-Agent":"Mozilla/5.0"}
      res = s.post(url,data=payload)
      soup = BeautifulSoup(res.text,"lxml")
      for items in soup.select("#skipNavigationToThisElement a"):
          print(items.text)
  </code></pre>
  
  <p>Any help to fix the problem will be vastly appreciated.</p>
  
  <p><strong><em>Image One</em></strong>
  <a href="https://i.stack.imgur.com/BFUgA.jpg" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/BFUgA.jpg" alt="enter image description here"></a></p>
  
  <p><strong><em>Image Two</em></strong></p>
  
  <p><a href="https://i.stack.imgur.com/ndTRM.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/ndTRM.png" alt="enter image description here"></a></p>