{"action":"closed","issue":{"url":"https://api.github.com/repos/dask/distributed/issues/30","repository_url":"https://api.github.com/repos/dask/distributed","labels_url":"https://api.github.com/repos/dask/distributed/issues/30/labels{/name}","comments_url":"https://api.github.com/repos/dask/distributed/issues/30/comments","events_url":"https://api.github.com/repos/dask/distributed/issues/30/events","html_url":"https://github.com/dask/distributed/issues/30","id":119313584,"number":30,"title":"Compression","user":{"login":"mrocklin","id":306380,"avatar_url":"https://avatars.githubusercontent.com/u/306380?v=3","gravatar_id":"","url":"https://api.github.com/users/mrocklin","html_url":"https://github.com/mrocklin","followers_url":"https://api.github.com/users/mrocklin/followers","following_url":"https://api.github.com/users/mrocklin/following{/other_user}","gists_url":"https://api.github.com/users/mrocklin/gists{/gist_id}","starred_url":"https://api.github.com/users/mrocklin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mrocklin/subscriptions","organizations_url":"https://api.github.com/users/mrocklin/orgs","repos_url":"https://api.github.com/users/mrocklin/repos","events_url":"https://api.github.com/users/mrocklin/events{/privacy}","received_events_url":"https://api.github.com/users/mrocklin/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-11-28T19:13:58Z","updated_at":"2016-03-02T01:53:40Z","closed_at":"2016-03-02T01:53:40Z","body":"Communications both between workers and between workers and center/scheduler/client can all, at times, benefit from compression.  Do we want to turn this on by default?  Do we want to make it optional?  If so, at what granularity should it be optional?\r\n\r\n*  Whole system\r\n*  Specified per worker/center/... object?\r\n*  Specified per communication?\r\n\r\nIf we specify it per communication then we'll have to have a proper header that is separate from the current payload.\r\n\r\n* What do other systems (spark, impala) do?\r\n* What compression systems are both very fast and widely available (or at least on conda)?"}}