{"action":"opened","issue":{"url":"https://api.github.com/repos/Data4Democracy/immigration-connect/issues/57","repository_url":"https://api.github.com/repos/Data4Democracy/immigration-connect","labels_url":"https://api.github.com/repos/Data4Democracy/immigration-connect/issues/57/labels{/name}","comments_url":"https://api.github.com/repos/Data4Democracy/immigration-connect/issues/57/comments","events_url":"https://api.github.com/repos/Data4Democracy/immigration-connect/issues/57/events","html_url":"https://github.com/Data4Democracy/immigration-connect/issues/57","id":381989352,"node_id":"MDU6SXNzdWUzODE5ODkzNTI=","number":57,"title":" Run scraper on local machine to gather regulations.gov comments for the NILC","user":{"login":"dotj","id":7132961,"node_id":"MDQ6VXNlcjcxMzI5NjE=","avatar_url":"https://avatars0.githubusercontent.com/u/7132961?v=4","gravatar_id":"","url":"https://api.github.com/users/dotj","html_url":"https://github.com/dotj","followers_url":"https://api.github.com/users/dotj/followers","following_url":"https://api.github.com/users/dotj/following{/other_user}","gists_url":"https://api.github.com/users/dotj/gists{/gist_id}","starred_url":"https://api.github.com/users/dotj/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dotj/subscriptions","organizations_url":"https://api.github.com/users/dotj/orgs","repos_url":"https://api.github.com/users/dotj/repos","events_url":"https://api.github.com/users/dotj/events{/privacy}","received_events_url":"https://api.github.com/users/dotj/received_events","type":"User","site_admin":false},"labels":[{"id":531090246,"node_id":"MDU6TGFiZWw1MzEwOTAyNDY=","url":"https://api.github.com/repos/Data4Democracy/immigration-connect/labels/beginner-friendly","name":"beginner-friendly","color":"0e8a16","default":false},{"id":531090324,"node_id":"MDU6TGFiZWw1MzEwOTAzMjQ=","url":"https://api.github.com/repos/Data4Democracy/immigration-connect/labels/data-collection","name":"data-collection","color":"fef2c0","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-11-18T19:03:00Z","updated_at":"2018-11-18T19:03:00Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"Continuation of #48:\r\n\r\nWe have not yet been able to get a VM up to run the scraper, so we need your help running the scraper locally in order to gather an initial dataset that the NILC can look at.\r\n\r\nThe documentation for the scraper can be found here: https://github.com/Data4Democracy/immigration-connect/tree/master/public-charge/scraper \r\n\r\nPing me or @alejandrox1 here (@julietdo or@alarcj on slack) if you need help,\r\n\r\nWe've seen each page (50 comments) take about 4 minutes to scrape, and there are currently almost 10k comments, so it will take about 13 hours total. Of course, this is dependent on your internet speed and various other factors.\r\n\r\n**Tasks**\r\n- Set up the scraper locally \r\n- Let the scraper run and collect all the comments (~13 hours)\r\n\r\n"}}
{"actor":{"display_login":"dotj"}}