title: Does Scrapy allow us to scrape data from a server using JavaScript scripts?
body: <p>in my college the webpage we retrieve our semester results by typing the name and the student ID.
  I am learning web scraping right now for projects, does scrapy or BeatifulSoup provide a solution for retrieving for example 100 results at one go?
  you can view it's content here : view-source:<a href="http://app1.helwan.edu.eg/Commerce/HasasnUpMlist.asp" rel="nofollow noreferrer">http://app1.helwan.edu.eg/Commerce/HasasnUpMlist.asp</a>
  it uses a code such as follows:</p>
  <p><div class="snippet" data-lang="js" data-hide="false" data-console="true" data-babel="false">
  <div class="snippet-code">
  <pre class="snippet-code-html lang-html prettyprint-override"><code>&lt;html&gt;
  &lt;head&gt;
      &lt;meta http-equiv="Content-Language" content="ar-eg"&gt;
      &lt;title&gt;&lt;/title&gt;
  
  &lt;link href="natiga.css" rel="stylesheet" type="text/css" /&gt;
  
  &lt;meta http-equiv="Content-Type" content="text/html; charset=windows-1256" /&gt;
  &lt;meta name="generator" content="Hassan_kandeell@yahoo.com" /&gt;
  &lt;/head&gt;
  &lt;body&gt;
  
  &lt;script type="text/javascript"&gt;
  &lt;!--
  var EW_DATE_SEPARATOR; // Default date separator
  EW_DATE_SEPARATOR = "/";
  if (EW_DATE_SEPARATOR == '') EW_DATE_SEPARATOR = '/';
  EW_UPLOAD_ALLOWED_FILE_EXT = "gif,jpg,jpeg,bmp,png,doc,xls,pdf,zip"; // Allowed upload file extension
  var EW_FIELD_SEP = ', '; // Default field separator
  // Ajax settings
  EW_LOOKUP_FILE_NAME = "ewlookup61.asp"; // lookup file name
  EW_ADD_OPTION_FILE_NAME = "ewaddopt61.asp"; // add option file name
  // Auto suggest settings
  var EW_AST_SELECT_LIST_ITEM = 0;
  var EW_AST_TEXT_BOX_ID;
  var EW_AST_CANCEL_SUBMIT;
  var EW_AST_OLD_TEXT_BOX_VALUE = "";
  var EW_AST_MAX_NEW_VALUE_LENGTH = 5; // Only get data if value length &lt;= this setting
  // Multipage settings
  var ew_PageIndex = 0;
  var ew_MaxPageIndex = 0;
  var ew_MinPageIndex = 0;
  var EW_TABLE_CLASSNAME = "ewTable"; // Note: changed the class name as needed
  var ew_MultiPageElements = new Array();
  //--&gt;
  &lt;/script&gt;
  &lt;script type="text/javascript" src="ew61.js"&gt;&lt;/script&gt;
  &lt;script type="text/javascript" src="userfn61.js"&gt;&lt;/script&gt;
  &lt;script language="JavaScript" type="text/javascript"&gt;
  &lt;!--
  // Write your client script here, no need to add script tags.
  // To include another .js script, use:
  // ew_ClientScriptInclude("my_javascript.js");
  //--&gt;
  &lt;/script&gt;
  &lt;div align="center"&gt;
      &lt;table border="0" width="1001" dir="rtl"&gt;
          &lt;tr&gt;
              &lt;td width="995" colspan="2"&gt;
              &lt;p align="center"&gt;
              &lt;img border="0" src="Start.JPG" width="995" height="198"&gt;&lt;/td&gt;
          &lt;/tr&gt;
          &lt;tr&gt;
              &lt;td bgcolor="#AC8601" width="737"&gt;
              &lt;p align="center"&gt;&amp;nbsp;&lt;/td&gt;
              &lt;td bgcolor="#800000" width="254"&gt;
              &lt;p align="center"&gt;&lt;font size="5" color="#FFFFFF"&gt;&lt;b&gt;نتائج كلية 
              التجارة وإدارة الأعمال&lt;/b&gt;&lt;/font&gt;&lt;/td&gt;
          &lt;/tr&gt;
      &lt;/table&gt;
  &lt;/div&gt;
  
  
  &lt;script type="text/javascript"&gt;
  &lt;!--
  var EW_PAGE_ID = "list"; // Page id
  //--&gt;
  &lt;/script&gt;
  &lt;script type="text/javascript"&gt;
  &lt;!--
  
  function ew_ValidateForm2(fobj) {
      var infix = "";
      for (var i=0;i&lt;fobj.elements.length;i++) {
          var elem = fobj.elements[i];
          if (elem.name.substring(0,2) == "s_" || elem.name.substring(0,3) == "sv_")
              elem.value = "";
      }
      return true;
  }
  //--&gt;</code></pre>
  </div>
  </div>
  </p>
  <p>I am just asking for educational purposes, I want to make a project for my colleagues because the traffic in the website is very high and it takes hours to get even one result.
  Thanks.</p>