{"action":"created","issue":{"url":"https://api.github.com/repos/spender-sandbox/cuckoo-modified/issues/335","repository_url":"https://api.github.com/repos/spender-sandbox/cuckoo-modified","labels_url":"https://api.github.com/repos/spender-sandbox/cuckoo-modified/issues/335/labels{/name}","comments_url":"https://api.github.com/repos/spender-sandbox/cuckoo-modified/issues/335/comments","events_url":"https://api.github.com/repos/spender-sandbox/cuckoo-modified/issues/335/events","html_url":"https://github.com/spender-sandbox/cuckoo-modified/issues/335","id":185019805,"number":335,"title":"malheur report module take too long for more than 10k analyses","user":{"login":"SeanKim777","id":10413320,"avatar_url":"https://avatars.githubusercontent.com/u/10413320?v=3","gravatar_id":"","url":"https://api.github.com/users/SeanKim777","html_url":"https://github.com/SeanKim777","followers_url":"https://api.github.com/users/SeanKim777/followers","following_url":"https://api.github.com/users/SeanKim777/following{/other_user}","gists_url":"https://api.github.com/users/SeanKim777/gists{/gist_id}","starred_url":"https://api.github.com/users/SeanKim777/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SeanKim777/subscriptions","organizations_url":"https://api.github.com/users/SeanKim777/orgs","repos_url":"https://api.github.com/users/SeanKim777/repos","events_url":"https://api.github.com/users/SeanKim777/events{/privacy}","received_events_url":"https://api.github.com/users/SeanKim777/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":7,"created_at":"2016-10-25T05:06:03Z","updated_at":"2016-10-27T11:40:56Z","closed_at":null,"body":"Hi\r\nIssue #193 seems created by malheur.py reporting module [Check source here](https://github.com/spender-sandbox/cuckoo-modified/blob/master/modules/reporting/malheur.py#L170)\r\n\r\nI have found generating melheur report take too long.\r\n14282 malheur dataset( == number of analysis) take more than 2mins. And it is expected to take more for more dataset.\r\n\r\n`$ ls -l ./test_dataset/ |wc -l`\r\n`14282`\r\n`$ time ./malheur -c ~/cuckoo/conf/malheur.conf -o ./test_increment.txt cluster ./test_dataset/`\r\n`real\t2m6.502s`\r\n`user\t6m27.744s`\r\n`sys\t0m1.729s`\r\n\r\nmalheur seems using multi-CPU while it's executing by looking at CPU usage and above user time.\r\nIt may hard to improving performance by updating malheur. (tested with malheur downloaded and compiled from [malheur git repo](https://github.com/rieck/malheur.git)  on today 25 Oct 2016)\r\n\r\nSo if there are more than 10K analyses then malheur report module need to run on a regular basis rather than each analysis like retention module.\r\n\r\nAny suggestion?\r\n"},"comment":{"url":"https://api.github.com/repos/spender-sandbox/cuckoo-modified/issues/comments/256618150","html_url":"https://github.com/spender-sandbox/cuckoo-modified/issues/335#issuecomment-256618150","issue_url":"https://api.github.com/repos/spender-sandbox/cuckoo-modified/issues/335","id":256618150,"user":{"login":"mallorybobalice","id":5554485,"avatar_url":"https://avatars.githubusercontent.com/u/5554485?v=3","gravatar_id":"","url":"https://api.github.com/users/mallorybobalice","html_url":"https://github.com/mallorybobalice","followers_url":"https://api.github.com/users/mallorybobalice/followers","following_url":"https://api.github.com/users/mallorybobalice/following{/other_user}","gists_url":"https://api.github.com/users/mallorybobalice/gists{/gist_id}","starred_url":"https://api.github.com/users/mallorybobalice/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mallorybobalice/subscriptions","organizations_url":"https://api.github.com/users/mallorybobalice/orgs","repos_url":"https://api.github.com/users/mallorybobalice/repos","events_url":"https://api.github.com/users/mallorybobalice/events{/privacy}","received_events_url":"https://api.github.com/users/mallorybobalice/received_events","type":"User","site_admin":false},"created_at":"2016-10-27T11:40:56Z","updated_at":"2016-10-27T11:40:56Z","body":"Ps edited plz check back "}}
{"actor":{"display_login":"mallorybobalice"}}