title: How to set up Scrapy, Anaconda 3 and PyCharm 2018.3.5
body: <p>I have just started experimenting with PyCharm 2018.3.5, Anaconda 2018.12, but I have a lot of difficulty of setting it up with Scrapy. Therefore, I would like to ask you all for some assistance, in order to get things up and running. I am following the following <a href="https://docs.scrapy.org/en/latest/intro/tutorial.html" rel="nofollow noreferrer">tutorial</a> in order to test whether Scrapy works with PyCharm and Anaconda. This does not seem to be the case. The setup is done on a Windows 10 machine with the latest updates.</p>
  
  <p>I have also included every step of the installation process and hopefully, you would be able to point where I went wrong.</p>
  
  <ol>
  <li>Installing Anaconda on the default location.</li>
  <li>Install PyCharm on the default location.</li>
  <li>Install OpenSSL (for this version of PyCharm, you need to install this apparently in order for it to find packages; link: <a href="https://slproweb.com/products/Win32OpenSSL.html" rel="nofollow noreferrer">https://slproweb.com/products/Win32OpenSSL.html</a>).</li>
  <li>I proceed to start PyCharm and create my first Scrapy project, using the follwing settings:
  <a href="https://i.stack.imgur.com/dRYi0.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/dRYi0.png" alt="PyCharm settings"></a></li>
  <li>I proceed to wait until PyCharm is done with everything and then I open Anaconda Navigator, which I will use to install <strong>scrapy</strong> and <strong>beautifulsoup4</strong>. The following image shows the result:
  <a href="https://i.stack.imgur.com/CLVuG.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/CLVuG.png" alt="Anaconda environment with Scrapy"></a></li>
  <li>In PyCharm, Scrapy is also visible:
  <a href="https://i.stack.imgur.com/vlAFw.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/vlAFw.png" alt="Scrapy in PyCharm"></a></li>
  <li>Next, I go into Explorer and navigate to <code>C:\Users\admin Man\PycharmProjects\Test</code> (Notice that this is the same directory as in step 4). </li>
  <li>So, first I tried using Command Prompt, but this fails: </li>
  </ol>
  
  <p><a href="https://i.stack.imgur.com/GtNHA.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/GtNHA.png" alt="Command prompt failure"></a></p>
  
  <p>I read that this is because the Anaconda Prompt does something with the paths. So I used the following command in Anaconda Prompt.</p>
  
  <p><a href="https://i.stack.imgur.com/PIP9j.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/PIP9j.png" alt="Anaconda Prompt Scray startproject"></a></p>
  
  <p><strong>A small question in between. I was wondering how I can make it work in cmd.exe what I did in Anaconda prompt without activating an environment</strong>. I think answering this question would give me a better understanding in what Anaconda prompt does.</p>
  
  <ol start="9">
  <li>This succeeds, now I have the following directory:</li>
  </ol>
  
  <p><a href="https://i.stack.imgur.com/ycE1G.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/ycE1G.png" alt="Directory of Scrapy project"></a></p>
  
  <ol start="10">
  <li>So I just followed the tutorial online and created the following spider. </li>
  </ol>
  
  <p><a href="https://i.stack.imgur.com/LfwH8.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/LfwH8.png" alt="Spider"></a></p>
  
  <ol start="11">
  <li>Then I set up the following configuration</li>
  </ol>
  
  <p><a href="https://i.stack.imgur.com/qLAK5.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/qLAK5.png" alt="Configuration"></a></p>
  
  <p>I tried to run with python console and emulate options, but that all fails. I checked whether I have the request package and I have request 2.21.0.</p>
  
  <p>The error I got is the following:</p>
  
  <pre><code>C:\ProgramData\Anaconda3\envs\Test\python.exe C:/ProgramData/Anaconda3/envs/Test/Lib/site-packages/scrapy/cmdline.py crawl quotes
  Traceback (most recent call last):
    File "C:/ProgramData/Anaconda3/envs/Test/Lib/site-packages/scrapy/cmdline.py", line 8, in &lt;module&gt;
      import scrapy
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\scrapy\__init__.py", line 27, in &lt;module&gt;
      from . import _monkeypatches
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\scrapy\_monkeypatches.py", line 20, in &lt;module&gt;
      import twisted.persisted.styles  # NOQA
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\twisted\persisted\styles.py", line 21, in &lt;module&gt;
      from twisted.python.compat import _PY3, _PYPY
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\twisted\python\__init__.py", line 11, in &lt;module&gt;
      from .compat import unicode
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\twisted\python\compat.py", line 605, in &lt;module&gt;
      from http import cookiejar as cookielib
    File "C:\ProgramData\Anaconda3\envs\Test\Lib\site-packages\scrapy\http\__init__.py", line 8, in &lt;module&gt;
      from scrapy.http.headers import Headers
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\scrapy\http\__init__.py", line 10, in &lt;module&gt;
      from scrapy.http.request import Request
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\scrapy\http\request\__init__.py", line 8, in &lt;module&gt;
      from w3lib.url import safe_url_string
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\w3lib\url.py", line 18, in &lt;module&gt;
      from six.moves.urllib.request import pathname2url, url2pathname
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\six.py", line 92, in __get__
      result = self._resolve()
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\six.py", line 160, in _resolve
      module = _import_module(self.mod)
    File "C:\ProgramData\Anaconda3\envs\Test\lib\site-packages\six.py", line 82, in _import_module
      __import__(name)
    File "C:\ProgramData\Anaconda3\envs\Test\lib\urllib\request.py", line 88, in &lt;module&gt;
      import http.client
  ModuleNotFoundError: No module named 'http.client'
  
  Process finished with exit code 1
  </code></pre>
  
  <p>Does anyone how I can fix it? In addition, I also tried setting up the working directory to something else, but I don't know to where, I tried of course the project directory.</p>
  
  <p>Actually, I can find the module that it seems to be missing (see below):</p>
  
  <p><a href="https://i.stack.imgur.com/eqzXt.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/eqzXt.png" alt="enter image description here"></a></p>