{"action":"created","issue":{"url":"https://api.github.com/repos/code4craft/webmagic/issues/273","repository_url":"https://api.github.com/repos/code4craft/webmagic","labels_url":"https://api.github.com/repos/code4craft/webmagic/issues/273/labels{/name}","comments_url":"https://api.github.com/repos/code4craft/webmagic/issues/273/comments","events_url":"https://api.github.com/repos/code4craft/webmagic/issues/273/events","html_url":"https://github.com/code4craft/webmagic/issues/273","id":141227592,"number":273,"title":"第一个爬虫项目的问题","user":{"login":"coderbird","id":13430027,"avatar_url":"https://avatars.githubusercontent.com/u/13430027?v=3","gravatar_id":"","url":"https://api.github.com/users/coderbird","html_url":"https://github.com/coderbird","followers_url":"https://api.github.com/users/coderbird/followers","following_url":"https://api.github.com/users/coderbird/following{/other_user}","gists_url":"https://api.github.com/users/coderbird/gists{/gist_id}","starred_url":"https://api.github.com/users/coderbird/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/coderbird/subscriptions","organizations_url":"https://api.github.com/users/coderbird/orgs","repos_url":"https://api.github.com/users/coderbird/repos","events_url":"https://api.github.com/users/coderbird/events{/privacy}","received_events_url":"https://api.github.com/users/coderbird/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2016-03-16T10:14:22Z","updated_at":"2016-03-24T07:27:35Z","closed_at":"2016-03-17T02:13:25Z","body":"运行了教程上爬取github的代码，但却爬取不到内容：\r\n2016-03-16 18:03:14,123 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/code4craft/netty\r\n2016-03-16 18:03:14,799 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/code4craft/tiny\r\n2016-03-16 18:03:15,613 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/ipiaoniu/piaoniu\r\n2016-03-16 18:03:18,955 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/easychen/howto\r\n2016-03-16 18:03:19,222 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/wifidog/wifidog\r\n2016-03-16 18:03:19,871 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/geeeeeeeeek/electronic\r\n2016-03-16 18:03:20,098 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/KasperDeng/Hubot\r\n2016-03-16 18:03:21,136 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/akagisho/mysql\r\n2016-03-16 18:03:21,802 WARN [us.codecraft.webmagic.downloader.HttpClientDownloader] - code error 404\thttps://github.com/biezhi/wechat\r\n奇怪的是这些url从来没有出现过啊，不知道是什么情况"},"comment":{"url":"https://api.github.com/repos/code4craft/webmagic/issues/comments/200703915","html_url":"https://github.com/code4craft/webmagic/issues/273#issuecomment-200703915","issue_url":"https://api.github.com/repos/code4craft/webmagic/issues/273","id":200703915,"user":{"login":"coderbird","id":13430027,"avatar_url":"https://avatars.githubusercontent.com/u/13430027?v=3","gravatar_id":"","url":"https://api.github.com/users/coderbird","html_url":"https://github.com/coderbird","followers_url":"https://api.github.com/users/coderbird/followers","following_url":"https://api.github.com/users/coderbird/following{/other_user}","gists_url":"https://api.github.com/users/coderbird/gists{/gist_id}","starred_url":"https://api.github.com/users/coderbird/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/coderbird/subscriptions","organizations_url":"https://api.github.com/users/coderbird/orgs","repos_url":"https://api.github.com/users/coderbird/repos","events_url":"https://api.github.com/users/coderbird/events{/privacy}","received_events_url":"https://api.github.com/users/coderbird/received_events","type":"User","site_admin":false},"created_at":"2016-03-24T07:27:35Z","updated_at":"2016-03-24T07:27:35Z","body":"@grofis ,这个问题是因为github上的某些规则变了，爬取url的正则不能匹配诸如“netty-learn”这样的，很多项目名称都有端杠了，你可以试着爬取其他网站，我爬取虎扑的时候挺好的"}}