{"action":"created","issue":{"url":"https://api.github.com/repos/certtools/intelmq/issues/600","repository_url":"https://api.github.com/repos/certtools/intelmq","labels_url":"https://api.github.com/repos/certtools/intelmq/issues/600/labels{/name}","comments_url":"https://api.github.com/repos/certtools/intelmq/issues/600/comments","events_url":"https://api.github.com/repos/certtools/intelmq/issues/600/events","html_url":"https://github.com/certtools/intelmq/issues/600","id":167078407,"number":600,"title":"shadowserver parser: can't parse open redis feed","user":{"login":"aaronkaplan","id":750019,"avatar_url":"https://avatars.githubusercontent.com/u/750019?v=3","gravatar_id":"","url":"https://api.github.com/users/aaronkaplan","html_url":"https://github.com/aaronkaplan","followers_url":"https://api.github.com/users/aaronkaplan/followers","following_url":"https://api.github.com/users/aaronkaplan/following{/other_user}","gists_url":"https://api.github.com/users/aaronkaplan/gists{/gist_id}","starred_url":"https://api.github.com/users/aaronkaplan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aaronkaplan/subscriptions","organizations_url":"https://api.github.com/users/aaronkaplan/orgs","repos_url":"https://api.github.com/users/aaronkaplan/repos","events_url":"https://api.github.com/users/aaronkaplan/events{/privacy}","received_events_url":"https://api.github.com/users/aaronkaplan/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/certtools/intelmq/labels/bug","name":"bug","color":"fc2929"},{"url":"https://api.github.com/repos/certtools/intelmq/labels/component:%20bots","name":"component: bots","color":"d4c5f9"}],"state":"open","locked":false,"assignee":{"login":"dmth","id":4152441,"avatar_url":"https://avatars.githubusercontent.com/u/4152441?v=3","gravatar_id":"","url":"https://api.github.com/users/dmth","html_url":"https://github.com/dmth","followers_url":"https://api.github.com/users/dmth/followers","following_url":"https://api.github.com/users/dmth/following{/other_user}","gists_url":"https://api.github.com/users/dmth/gists{/gist_id}","starred_url":"https://api.github.com/users/dmth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dmth/subscriptions","organizations_url":"https://api.github.com/users/dmth/orgs","repos_url":"https://api.github.com/users/dmth/repos","events_url":"https://api.github.com/users/dmth/events{/privacy}","received_events_url":"https://api.github.com/users/dmth/received_events","type":"User","site_admin":false},"assignees":[{"login":"dmth","id":4152441,"avatar_url":"https://avatars.githubusercontent.com/u/4152441?v=3","gravatar_id":"","url":"https://api.github.com/users/dmth","html_url":"https://github.com/dmth","followers_url":"https://api.github.com/users/dmth/followers","following_url":"https://api.github.com/users/dmth/following{/other_user}","gists_url":"https://api.github.com/users/dmth/gists{/gist_id}","starred_url":"https://api.github.com/users/dmth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dmth/subscriptions","organizations_url":"https://api.github.com/users/dmth/orgs","repos_url":"https://api.github.com/users/dmth/repos","events_url":"https://api.github.com/users/dmth/events{/privacy}","received_events_url":"https://api.github.com/users/dmth/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/certtools/intelmq/milestones/2","html_url":"https://github.com/certtools/intelmq/milestones/Release%20v1.0","labels_url":"https://api.github.com/repos/certtools/intelmq/milestones/2/labels","id":719078,"number":2,"title":"Release v1.0","description":"First stable version.","creator":{"login":"SYNchroACK","id":4184292,"avatar_url":"https://avatars.githubusercontent.com/u/4184292?v=3","gravatar_id":"","url":"https://api.github.com/users/SYNchroACK","html_url":"https://github.com/SYNchroACK","followers_url":"https://api.github.com/users/SYNchroACK/followers","following_url":"https://api.github.com/users/SYNchroACK/following{/other_user}","gists_url":"https://api.github.com/users/SYNchroACK/gists{/gist_id}","starred_url":"https://api.github.com/users/SYNchroACK/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SYNchroACK/subscriptions","organizations_url":"https://api.github.com/users/SYNchroACK/orgs","repos_url":"https://api.github.com/users/SYNchroACK/repos","events_url":"https://api.github.com/users/SYNchroACK/events{/privacy}","received_events_url":"https://api.github.com/users/SYNchroACK/received_events","type":"User","site_admin":false},"open_issues":30,"closed_issues":280,"state":"open","created_at":"2014-07-12T18:19:52Z","updated_at":"2016-07-22T16:59:22Z","due_on":"2016-08-30T22:00:00Z","closed_at":null},"comments":5,"created_at":"2016-07-22T16:03:27Z","updated_at":"2016-07-22T18:01:20Z","closed_at":null,"body":"```\r\n2016-07-22 18:00:38,243 - openredis-parser - ERROR - Failed to parse line.\r\nTraceback (most recent call last):\r\n  File \"/home/aaron/intelmq/intelmq/lib/bot.py\", line 461, in process\r\n    events = list(filter(bool, self.parse_line(line, report)))\r\n  File \"/home/aaron/intelmq/intelmq/bots/parsers/shadowserver/parser.py\", line 182, in parse_line\r\n    event.add('raw', self.recover_line(raw_line))\r\n  File \"/home/aaron/intelmq/intelmq/bots/parsers/shadowserver/parser.py\", line 198, in recover_line\r\n    out += ','.join(ordered_line) + '\\n'\r\nTypeError: sequence item 13: expected str instance, NoneType found\r\n2016-07-22 18:00:38,243 - openredis-parser - INFO - Dumping message from pipeline to dump file.\r\n```"},"comment":{"url":"https://api.github.com/repos/certtools/intelmq/issues/comments/234613290","html_url":"https://github.com/certtools/intelmq/issues/600#issuecomment-234613290","issue_url":"https://api.github.com/repos/certtools/intelmq/issues/600","id":234613290,"user":{"login":"aaronkaplan","id":750019,"avatar_url":"https://avatars.githubusercontent.com/u/750019?v=3","gravatar_id":"","url":"https://api.github.com/users/aaronkaplan","html_url":"https://github.com/aaronkaplan","followers_url":"https://api.github.com/users/aaronkaplan/followers","following_url":"https://api.github.com/users/aaronkaplan/following{/other_user}","gists_url":"https://api.github.com/users/aaronkaplan/gists{/gist_id}","starred_url":"https://api.github.com/users/aaronkaplan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aaronkaplan/subscriptions","organizations_url":"https://api.github.com/users/aaronkaplan/orgs","repos_url":"https://api.github.com/users/aaronkaplan/repos","events_url":"https://api.github.com/users/aaronkaplan/events{/privacy}","received_events_url":"https://api.github.com/users/aaronkaplan/received_events","type":"User","site_admin":false},"created_at":"2016-07-22T18:01:20Z","updated_at":"2016-07-22T18:01:20Z","body":"okay, Thanks @bernhard-herzog for the analysis! I was just in quick-fix mode :)\r\nI agree, this whole parse should be looked at again and made \r\n  1.  more stable and robust\r\n  2. clearer and easier to debug\r\n  3. have better error handling (see #592 )\r\n\r\n"}}
{"actor":{"display_login":"aaronkaplan"}}