{"action":"closed","issue":{"url":"https://api.github.com/repos/csirtgadgets/bearded-avenger/issues/16","repository_url":"https://api.github.com/repos/csirtgadgets/bearded-avenger","labels_url":"https://api.github.com/repos/csirtgadgets/bearded-avenger/issues/16/labels{/name}","comments_url":"https://api.github.com/repos/csirtgadgets/bearded-avenger/issues/16/comments","events_url":"https://api.github.com/repos/csirtgadgets/bearded-avenger/issues/16/events","html_url":"https://github.com/csirtgadgets/bearded-avenger/issues/16","id":107520844,"number":16,"title":"cache feeds differently than in v2","user":{"login":"giovino","id":1413931,"avatar_url":"https://avatars.githubusercontent.com/u/1413931?v=3","gravatar_id":"","url":"https://api.github.com/users/giovino","html_url":"https://github.com/giovino","followers_url":"https://api.github.com/users/giovino/followers","following_url":"https://api.github.com/users/giovino/following{/other_user}","gists_url":"https://api.github.com/users/giovino/gists{/gist_id}","starred_url":"https://api.github.com/users/giovino/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/giovino/subscriptions","organizations_url":"https://api.github.com/users/giovino/orgs","repos_url":"https://api.github.com/users/giovino/repos","events_url":"https://api.github.com/users/giovino/events{/privacy}","received_events_url":"https://api.github.com/users/giovino/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/csirtgadgets/bearded-avenger/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"closed","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/csirtgadgets/bearded-avenger/milestones/4","html_url":"https://github.com/csirtgadgets/bearded-avenger/milestones/R6","labels_url":"https://api.github.com/repos/csirtgadgets/bearded-avenger/milestones/4/labels","id":1670614,"number":4,"title":"R6","description":"","creator":{"login":"wesyoung","id":474878,"avatar_url":"https://avatars.githubusercontent.com/u/474878?v=3","gravatar_id":"","url":"https://api.github.com/users/wesyoung","html_url":"https://github.com/wesyoung","followers_url":"https://api.github.com/users/wesyoung/followers","following_url":"https://api.github.com/users/wesyoung/following{/other_user}","gists_url":"https://api.github.com/users/wesyoung/gists{/gist_id}","starred_url":"https://api.github.com/users/wesyoung/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wesyoung/subscriptions","organizations_url":"https://api.github.com/users/wesyoung/orgs","repos_url":"https://api.github.com/users/wesyoung/repos","events_url":"https://api.github.com/users/wesyoung/events{/privacy}","received_events_url":"https://api.github.com/users/wesyoung/received_events","type":"User","site_admin":false},"open_issues":2,"closed_issues":2,"state":"open","created_at":"2016-03-28T21:55:43Z","updated_at":"2016-05-24T17:25:07Z","due_on":"2016-09-30T04:00:00Z","closed_at":null},"comments":0,"created_at":"2015-09-21T14:07:58Z","updated_at":"2016-05-24T17:25:07Z","closed_at":"2016-05-24T17:25:07Z","body":"in cifv2 we cache a feed appended with the feed name in the feed config. This causes us to download the same feed multiple times if we were to do something like this:\r\n\r\n```\r\ndga-feed-cryptolocker:\r\n  remote: http://osint.bambenekconsulting.com/feeds/dga-feed.txt\r\n  pattern: ^([^,]+)\\,Domain used by (Cryptolocker[^,]+)\\,([^,]+)\\,([^\\r\\n]+)\r\ndga-feed-p2p-gameover-zeus:\r\n  remote: http://osint.bambenekconsulting.com/feeds/dga-feed.txt\r\n  pattern: ^([^,]+)\\,Domain used by (P2P Gameover Zeus[^,]+)\\,([^,]+)\\,([^\\r\\n]+)\r\n```\r\n\r\nThis results in dga-feed.txt downloaded multiple times:\r\n\r\n```\r\nls -lh /var/smrt/cache/osint.bambenekconsulting.com-dga*\r\n-rw-rw-r-- 1 cif cif 83M Sep 20 20:15 /var/smrt/cache/osint.bambenekconsulting.com-dga-feed-cryptolocker\r\n-rw-rw-r-- 1 cif cif 83M Sep 20 20:15 /var/smrt/cache/osint.bambenekconsulting.com-dga-feed-p2p-gameover-zeus\r\n```\r\n\r\nIn v3 let's attempt to only download dga-feed.txt one time, cache it and then parsed the single cached feed. "}}
{"actor":{"display_login":"wesyoung"}}