title: Scrapy does not print the sites crawling on
body: <pre class="lang-html prettyprint-override"><code>    &lt;a href=&quot;/what-to-watch/fan-favorites/?ref_=hm_fanfav_sm&quot; class=&quot;ipc-title ipc-title--
      subsection-title ipc-title--baseAlt ipc-title--on-textPrimary ipc-title-link-wrapper&quot; 
      tabindex=&quot;0&quot;&gt;&lt;h3 class=&quot;ipc-title__text&quot;&gt;Fan favorites&lt;svg width=&quot;24&quot; height=&quot;24&quot; 
      xmlns=&quot;http://www.w3.org/2000/svg&quot; class=&quot;ipc-icon ipc-icon--chevron-right-inline ipc-
      icon--inline ipc-title-link-chevron&quot; viewBox=&quot;0 0 24 24&quot; fill=&quot;currentColor&quot; 
      role=&quot;presentation&quot;&gt;&lt;path d=&quot;M5.622.631A2.153 2.153 0 0 0 5 2.147c0 .568.224 1.113.622 
      1.515l8.249 8.34-8.25 8.34a2.16 2.16 0 0 0-.548 2.07c.196.74.768 1.317 1.499 1.515a2.104 
      2.104 0 0 0 2.048-.555l9.758-9.866a2.153 2.153 0 0 0 0-3.03L8.62.61C7.812-.207 6.45-.207 
      5.622.63z&quot;&gt;&lt;/path&gt;&lt;/svg&gt;&lt;/h3&gt;&lt;div class=&quot;ipc-title__description&quot;&gt;This week's top TV and 
      movies&lt;/div&gt;&lt;/a&gt;
  </code></pre>
  <p>and</p>
  <pre class="lang-html prettyprint-override"><code>        &lt;a class=&quot;ipc-poster-card__title ipc-poster-card__title--clamp-2
      ipc-poster-card__title--clickable&quot; aria-label=&quot;View title page for 
      Shang-Chi and the Legend of the Ten Rings&quot; href=&quot;/title/tt9376612/?
      ref_=watch_fanfav_tt_t_2&quot;&gt;&lt;span data-testid=&quot;title&quot;&gt;Shang-Chi and the 
      Legend of the Ten Rings&lt;/span&gt;&lt;/a&gt;
  </code></pre>
  <p>Are the HTML structures of the sites I want my spider to crawl with the code:</p>
  <pre class="lang-py prettyprint-override"><code>    import scrapy
      from scrapy.crawler import CrawlerProcess
      
      class imdb_favorites(scrapy.Spider):
          
          name = &quot;imdB Favorites&quot;
          
          def start_requests(self):
              url = &quot;https://www.imdb.com&quot;
              yield scrapy.Request(url = url,
                                  callback = self.parse_front)
              
          def parse_front(self, response):
              # Get the link of 'What to watch section'
              fan_favorites = response.css('div.fan-picks&gt;a::attr(href)')
              link_to_follow =  fan_favorites.extract()
              for i in link_to_follow:
                  url2 = url + i 
                  print(url2)
                  yield response.follow(url = url2,
                                        callback = self.parse_2)
              
          def parse_2(self, response):
              # Gets the links of the movies in what to watch section.
              what_to_watch = response.css('a.ipc-poster-card__title::attr(href)').extract()
              for a in what_to_watch:
                  url3 = &quot;https://www.imdb.com&quot; + a
                  print(url3)
                  yield response.follow(url = url3,
                                       callback = parse_3)
                  
      process= CrawlerProcess()
      process.crawl(imdb_favorites)
      process.start()
  </code></pre>
  <p>The problem is that print() functions do not work in for loops so I cannot see if my code crawls properly or not so I cannot teach myself furthermore. Thanks your interest.</p>