title: scrapy docs author spider couldn't crawl internal link
body: <p>I tried the <code>AuthorSpider</code> in scrapy docs, but it doesn't return the author page for me, it even doesn't go to <code>parse_author()</code> method, I want to crawl a website with several internal links, then follow the link to crawl the article, I tried all the scrapy code to use <code>response.follow()</code> with several parse method, but it only called the first <code>parse()</code> method, the <code>parse_author()</code> method never get called.</p>