{"action":"created","issue":{"url":"https://api.github.com/repos/frictionlessdata/specs/issues/290","repository_url":"https://api.github.com/repos/frictionlessdata/specs","labels_url":"https://api.github.com/repos/frictionlessdata/specs/issues/290/labels{/name}","comments_url":"https://api.github.com/repos/frictionlessdata/specs/issues/290/comments","events_url":"https://api.github.com/repos/frictionlessdata/specs/issues/290/events","html_url":"https://github.com/frictionlessdata/specs/issues/290","id":176224908,"number":290,"title":"Compressed resources","user":{"login":"rgrp","id":180658,"avatar_url":"https://avatars.githubusercontent.com/u/180658?v=3","gravatar_id":"","url":"https://api.github.com/users/rgrp","html_url":"https://github.com/rgrp","followers_url":"https://api.github.com/users/rgrp/followers","following_url":"https://api.github.com/users/rgrp/following{/other_user}","gists_url":"https://api.github.com/users/rgrp/gists{/gist_id}","starred_url":"https://api.github.com/users/rgrp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rgrp/subscriptions","organizations_url":"https://api.github.com/users/rgrp/orgs","repos_url":"https://api.github.com/users/rgrp/repos","events_url":"https://api.github.com/users/rgrp/events{/privacy}","received_events_url":"https://api.github.com/users/rgrp/received_events","type":"User","site_admin":false},"labels":[{"id":451350256,"url":"https://api.github.com/repos/frictionlessdata/specs/labels/blocker","name":"blocker","color":"d93f0b","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/frictionlessdata/specs/milestones/1","html_url":"https://github.com/frictionlessdata/specs/milestones/Current","labels_url":"https://api.github.com/repos/frictionlessdata/specs/milestones/1/labels","id":1814953,"number":1,"title":"Current","description":"","creator":{"login":"pwalsh","id":791678,"avatar_url":"https://avatars.githubusercontent.com/u/791678?v=3","gravatar_id":"","url":"https://api.github.com/users/pwalsh","html_url":"https://github.com/pwalsh","followers_url":"https://api.github.com/users/pwalsh/followers","following_url":"https://api.github.com/users/pwalsh/following{/other_user}","gists_url":"https://api.github.com/users/pwalsh/gists{/gist_id}","starred_url":"https://api.github.com/users/pwalsh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pwalsh/subscriptions","organizations_url":"https://api.github.com/users/pwalsh/orgs","repos_url":"https://api.github.com/users/pwalsh/repos","events_url":"https://api.github.com/users/pwalsh/events{/privacy}","received_events_url":"https://api.github.com/users/pwalsh/received_events","type":"User","site_admin":false},"open_issues":12,"closed_issues":0,"state":"open","created_at":"2016-06-08T06:04:57Z","updated_at":"2016-09-28T12:35:13Z","due_on":null,"closed_at":null},"comments":3,"created_at":"2016-09-11T06:35:34Z","updated_at":"2016-11-10T08:16:12Z","closed_at":null,"body":"Idea: describe resource compression. This would allow compression to be \"ignored\" in describing format and e.g. allow a tabular data package to include compressed CSV not just plain CSV.\n\nWhy? In much data management especially with larger dataset compressions is important for economies of storage and transmission. At the moment, data file compression is not explicitly supported by the specification. This also means that profiles like tabular data package or geo data package require that resources are uncompressed.\n## Proposal\n\nIntroduce a `compression` property on resource\n\n```\n...\npath: mydata.csv.gz\nformat: \"csv\",\ncompression: \"gz\" # | bz2 | lzo | zip\n...\n```\n\nQuestion: what compression formats do we support?\n- Do we support `zip`? It is very common, however quite a bit of tooling e.g. AWS Redshift does not support it.\n- What about tar + gzip?\n\nResearch:\n- Standard linux: zip, gzip, bzip2\n- Standard Mac install: zip, gzip\n  - lzop available via brew\n- Python: stdlib: zip, gzip, bz2; external: lzop\n- Node: stdlib: gzip; external: zip, bz2, lzop\n- [AWS Redshift supports](http://docs.aws.amazon.com/redshift/latest/dg/t_loading-gzip-compressed-data-files-from-S3.html): gzip, bz2, lzop\n- [Google BigQuery indicates support](https://cloud.google.com/bigquery/preparing-data-for-loading) for at least gzip\n"},"comment":{"url":"https://api.github.com/repos/frictionlessdata/specs/issues/comments/259627628","html_url":"https://github.com/frictionlessdata/specs/issues/290#issuecomment-259627628","issue_url":"https://api.github.com/repos/frictionlessdata/specs/issues/290","id":259627628,"user":{"login":"pwalsh","id":791678,"avatar_url":"https://avatars.githubusercontent.com/u/791678?v=3","gravatar_id":"","url":"https://api.github.com/users/pwalsh","html_url":"https://github.com/pwalsh","followers_url":"https://api.github.com/users/pwalsh/followers","following_url":"https://api.github.com/users/pwalsh/following{/other_user}","gists_url":"https://api.github.com/users/pwalsh/gists{/gist_id}","starred_url":"https://api.github.com/users/pwalsh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pwalsh/subscriptions","organizations_url":"https://api.github.com/users/pwalsh/orgs","repos_url":"https://api.github.com/users/pwalsh/repos","events_url":"https://api.github.com/users/pwalsh/events{/privacy}","received_events_url":"https://api.github.com/users/pwalsh/received_events","type":"User","site_admin":false},"created_at":"2016-11-10T08:16:12Z","updated_at":"2016-11-10T08:16:12Z","body":"any comments on this from the @frictionlessdata/specs-working-group ?"}}
{"actor":{"display_login":"pwalsh"}}