{"action":"opened","issue":{"url":"https://api.github.com/repos/lapwinglabs/x-ray/issues/178","repository_url":"https://api.github.com/repos/lapwinglabs/x-ray","labels_url":"https://api.github.com/repos/lapwinglabs/x-ray/issues/178/labels{/name}","comments_url":"https://api.github.com/repos/lapwinglabs/x-ray/issues/178/comments","events_url":"https://api.github.com/repos/lapwinglabs/x-ray/issues/178/events","html_url":"https://github.com/lapwinglabs/x-ray/issues/178","id":151276664,"number":178,"title":"404 & 500 url validation","user":{"login":"JephMarketing","id":12238413,"avatar_url":"https://avatars.githubusercontent.com/u/12238413?v=3","gravatar_id":"","url":"https://api.github.com/users/JephMarketing","html_url":"https://github.com/JephMarketing","followers_url":"https://api.github.com/users/JephMarketing/followers","following_url":"https://api.github.com/users/JephMarketing/following{/other_user}","gists_url":"https://api.github.com/users/JephMarketing/gists{/gist_id}","starred_url":"https://api.github.com/users/JephMarketing/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JephMarketing/subscriptions","organizations_url":"https://api.github.com/users/JephMarketing/orgs","repos_url":"https://api.github.com/users/JephMarketing/repos","events_url":"https://api.github.com/users/JephMarketing/events{/privacy}","received_events_url":"https://api.github.com/users/JephMarketing/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2016-04-27T01:28:50Z","updated_at":"2016-04-27T01:28:50Z","closed_at":null,"body":"### Subject of the issue\r\nI am crawling and pulling emails from numerous sites, however, when I add a broken link to my array of urls to crawl I break my script. I am curious if there is anything built in to handle 404 and 505. \r\n\r\n### Your environment\r\nnode 4.4.3\r\nnpm 2.15.1 (comes with node.js download)\r\n\r\n\r\n### Expected behaviour\r\n\r\nRight now if all links are valid in the import .csv file then it works beautifully, if not I get the following error: \r\n{ [Error: getaddrinfo ENOTFOUND -------------.com -------------.com:80]\r\n  code: 'ENOTFOUND',\r\n  errno: 'ENOTFOUND',\r\n  syscall: 'getaddrinfo',\r\n  hostname: '--------.com',\r\n  host: '------------.com',\r\n  port: 80,\r\n  response: undefined }\r\n\r\nI am sorry if I missed this in the docs or if it is an easy question, but I really am trying to find a simple and efficient solution. Thanks in advance for your help!"}}