{"action":"created","issue":{"url":"https://api.github.com/repos/mozilla/Snappy-Symbolication-Server/issues/25","repository_url":"https://api.github.com/repos/mozilla/Snappy-Symbolication-Server","labels_url":"https://api.github.com/repos/mozilla/Snappy-Symbolication-Server/issues/25/labels{/name}","comments_url":"https://api.github.com/repos/mozilla/Snappy-Symbolication-Server/issues/25/comments","events_url":"https://api.github.com/repos/mozilla/Snappy-Symbolication-Server/issues/25/events","html_url":"https://github.com/mozilla/Snappy-Symbolication-Server/issues/25","id":160914161,"number":25,"title":"Evaluate compressing symbol files","user":{"login":"gabrielesvelto","id":1159312,"avatar_url":"https://avatars.githubusercontent.com/u/1159312?v=3","gravatar_id":"","url":"https://api.github.com/users/gabrielesvelto","html_url":"https://github.com/gabrielesvelto","followers_url":"https://api.github.com/users/gabrielesvelto/followers","following_url":"https://api.github.com/users/gabrielesvelto/following{/other_user}","gists_url":"https://api.github.com/users/gabrielesvelto/gists{/gist_id}","starred_url":"https://api.github.com/users/gabrielesvelto/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gabrielesvelto/subscriptions","organizations_url":"https://api.github.com/users/gabrielesvelto/orgs","repos_url":"https://api.github.com/users/gabrielesvelto/repos","events_url":"https://api.github.com/users/gabrielesvelto/events{/privacy}","received_events_url":"https://api.github.com/users/gabrielesvelto/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2016-06-17T15:27:05Z","updated_at":"2016-06-22T18:23:31Z","closed_at":null,"body":"Symbol files tend to compress very well: 80%+ when using `gzip --fast`, possibly much more with more aggressive compression. We should evaluate storing the symbol files in compressed format to disk; it could dramatically increase the effective size of the cache."},"comment":{"url":"https://api.github.com/repos/mozilla/Snappy-Symbolication-Server/issues/comments/227833513","html_url":"https://github.com/mozilla/Snappy-Symbolication-Server/issues/25#issuecomment-227833513","issue_url":"https://api.github.com/repos/mozilla/Snappy-Symbolication-Server/issues/25","id":227833513,"user":{"login":"willkg","id":820826,"avatar_url":"https://avatars.githubusercontent.com/u/820826?v=3","gravatar_id":"","url":"https://api.github.com/users/willkg","html_url":"https://github.com/willkg","followers_url":"https://api.github.com/users/willkg/followers","following_url":"https://api.github.com/users/willkg/following{/other_user}","gists_url":"https://api.github.com/users/willkg/gists{/gist_id}","starred_url":"https://api.github.com/users/willkg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/willkg/subscriptions","organizations_url":"https://api.github.com/users/willkg/orgs","repos_url":"https://api.github.com/users/willkg/repos","events_url":"https://api.github.com/users/willkg/events{/privacy}","received_events_url":"https://api.github.com/users/willkg/received_events","type":"User","site_admin":false},"created_at":"2016-06-22T18:23:31Z","updated_at":"2016-06-22T18:23:31Z","body":"I used @rhelmer's approach and tried gzip and bz2--both are in the python stdlib. I used the highest compression levels for both (it's the default in both cases).\r\n\r\n```\r\n> ls -l cache*\r\ncache.orig:\r\ntotal 13944\r\n-rw-rw-r-- 1 willkg willkg 14136768 Jun 22 11:52 44E4EC8C2F41492B9369D6B9A059577C2@xul.pdb\r\n-rw-rw-r-- 1 willkg willkg   138777 Jun 22 11:52 D74F79EB1F8D4A45ABCD2F476CCABACC2@wntdll.pdb\r\n\r\ncache.gzip:\r\ntotal 2784\r\n-rw-rw-r-- 1 willkg willkg 2801576 Jun 22 14:09 44E4EC8C2F41492B9369D6B9A059577C2@xul.pdb\r\n-rw-rw-r-- 1 willkg willkg   46257 Jun 22 14:09 D74F79EB1F8D4A45ABCD2F476CCABACC2@wntdll.pdb\r\n\r\ncache.bz2:\r\ntotal 2304\r\n-rw-rw-r-- 1 willkg willkg 2312957 Jun 22 14:17 44E4EC8C2F41492B9369D6B9A059577C2@xul.pdb\r\n-rw-rw-r-- 1 willkg willkg   43572 Jun 22 14:17 D74F79EB1F8D4A45ABCD2F476CCABACC2@wntdll.pdb\r\n```\r\n\r\nSo for the biggest of those two files, we went from 14.1mb to 2.3mb with bz2. That's ~83% savings. That lines up with what @gabrielesvelto saw.\r\n\r\nI'll throw together a PR."}}
{"actor":{"display_login":"willkg"}}