{"action":"closed","number":102,"pull_request":{"url":"https://api.github.com/repos/frictionlessdata/goodtables/pulls/102","id":70582337,"html_url":"https://github.com/frictionlessdata/goodtables/pull/102","diff_url":"https://github.com/frictionlessdata/goodtables/pull/102.diff","patch_url":"https://github.com/frictionlessdata/goodtables/pull/102.patch","issue_url":"https://api.github.com/repos/frictionlessdata/goodtables/issues/102","number":102,"state":"closed","locked":false,"title":"Improve encoding detection","user":{"login":"georgiana-b","id":8862002,"avatar_url":"https://avatars.githubusercontent.com/u/8862002?v=3","gravatar_id":"","url":"https://api.github.com/users/georgiana-b","html_url":"https://github.com/georgiana-b","followers_url":"https://api.github.com/users/georgiana-b/followers","following_url":"https://api.github.com/users/georgiana-b/following{/other_user}","gists_url":"https://api.github.com/users/georgiana-b/gists{/gist_id}","starred_url":"https://api.github.com/users/georgiana-b/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/georgiana-b/subscriptions","organizations_url":"https://api.github.com/users/georgiana-b/orgs","repos_url":"https://api.github.com/users/georgiana-b/repos","events_url":"https://api.github.com/users/georgiana-b/events{/privacy}","received_events_url":"https://api.github.com/users/georgiana-b/received_events","type":"User","site_admin":false},"body":"I replaced `chardet` with [`cchardet`](https://github.com/PyYoshi/cChardet) and deployed it [on this heroku app](https://try-cchardet-goodatbles.herokuapp.com/). \r\nThis is the response of an API call with a shorter version of the problematic file in #100. Notice the encoding is properly detected. \r\n\r\n```\r\ncurl https://try-cchardet-goodatbles.herokuapp.com/api/run --data \"data=https://a.uguu.se/FqnfZ5ynn5kB_short_test.csv\"\r\n{\r\n    \"report\": {\r\n        \"meta\": {\r\n            \"bad_column_count\": 0,\r\n            \"bad_row_count\": 1,\r\n            \"columns\": [\r\n                {\r\n                    \"bad_type_percent\": 0,\r\n                    \"index\": 0,\r\n                    \"name\": \"Ciclo,Ramo,RAMO_DESCRIPCION,UNIDAD,UNIDAD_DESCRIPCION,GF,GRUPO_FUN_DESCRIPCION,FN,FUNCIONL_DESCRIPCION,SF,SUBFUNCIONL_DESCRIPCION,RA,REASIGNACION_DESCRIPCION,AI,ACTIVIDAD_INST_DESCRIPCION,MOD,MODALIDAD_DESCRIPCION,PP,PROGR_PRES_DESCRIPCION,CONCEPTO,CONCEPTO_DESCRIPCION,TG,TIPO_GASTO_DESCRIPCION,FF,FUENTE_FINAN_DESCRIPCION,EF,ENTIDAD_FED_DESCRIPCION,CLAVE_CARTERA,PEF_2016\"\r\n                }\r\n            ],\r\n            \"encoding\": \"windows-1252\",\r\n            \"header_index\": 0,\r\n            \"headers\": [\r\n                \"Ciclo,Ramo,RAMO_DESCRIPCION,UNIDAD,UNIDAD_DESCRIPCION,GF,GRUPO_FUN_DESCRIPCION,FN,FUNCIONL_DESCRIPCION,SF,SUBFUNCIONL_DESCRIPCION,RA,REASIGNACION_DESCRIPCION,AI,ACTIVIDAD_INST_DESCRIPCION,MOD,MODALIDAD_DESCRIPCION,PP,PROGR_PRES_DESCRIPCION,CONCEPTO,CONCEPTO_DESCRIPCION,TG,TIPO_GASTO_DESCRIPCION,FF,FUENTE_FINAN_DESCRIPCION,EF,ENTIDAD_FED_DESCRIPCION,CLAVE_CARTERA,PEF_2016\"\r\n            ],\r\n            \"name\": \"Pipeline\",\r\n            \"row_count\": 1\r\n        },\r\n```","created_at":"2016-05-18T19:07:52Z","updated_at":"2016-05-19T05:24:41Z","closed_at":"2016-05-19T05:24:41Z","merged_at":"2016-05-19T05:24:41Z","merge_commit_sha":"6cd32d833becef92de9fb272a1ec1ea773f8f7c6","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/frictionlessdata/goodtables/pulls/102/commits","review_comments_url":"https://api.github.com/repos/frictionlessdata/goodtables/pulls/102/comments","review_comment_url":"https://api.github.com/repos/frictionlessdata/goodtables/pulls/comments{/number}","comments_url":"https://api.github.com/repos/frictionlessdata/goodtables/issues/102/comments","statuses_url":"https://api.github.com/repos/frictionlessdata/goodtables/statuses/60fd0eb450bedb424242dd077c05e27c5a1c7e91","head":{"label":"frictionlessdata:feature/improve_encoding_detection","ref":"feature/improve_encoding_detection","sha":"60fd0eb450bedb424242dd077c05e27c5a1c7e91","user":{"login":"frictionlessdata","id":5912125,"avatar_url":"https://avatars.githubusercontent.com/u/5912125?v=3","gravatar_id":"","url":"https://api.github.com/users/frictionlessdata","html_url":"https://github.com/frictionlessdata","followers_url":"https://api.github.com/users/frictionlessdata/followers","following_url":"https://api.github.com/users/frictionlessdata/following{/other_user}","gists_url":"https://api.github.com/users/frictionlessdata/gists{/gist_id}","starred_url":"https://api.github.com/users/frictionlessdata/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/frictionlessdata/subscriptions","organizations_url":"https://api.github.com/users/frictionlessdata/orgs","repos_url":"https://api.github.com/users/frictionlessdata/repos","events_url":"https://api.github.com/users/frictionlessdata/events{/privacy}","received_events_url":"https://api.github.com/users/frictionlessdata/received_events","type":"Organization","site_admin":false},"repo":{"id":28409905,"name":"goodtables","full_name":"frictionlessdata/goodtables","owner":{"login":"frictionlessdata","id":5912125,"avatar_url":"https://avatars.githubusercontent.com/u/5912125?v=3","gravatar_id":"","url":"https://api.github.com/users/frictionlessdata","html_url":"https://github.com/frictionlessdata","followers_url":"https://api.github.com/users/frictionlessdata/followers","following_url":"https://api.github.com/users/frictionlessdata/following{/other_user}","gists_url":"https://api.github.com/users/frictionlessdata/gists{/gist_id}","starred_url":"https://api.github.com/users/frictionlessdata/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/frictionlessdata/subscriptions","organizations_url":"https://api.github.com/users/frictionlessdata/orgs","repos_url":"https://api.github.com/users/frictionlessdata/repos","events_url":"https://api.github.com/users/frictionlessdata/events{/privacy}","received_events_url":"https://api.github.com/users/frictionlessdata/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/frictionlessdata/goodtables","description":"Validate and process tabular data.","fork":false,"url":"https://api.github.com/repos/frictionlessdata/goodtables","forks_url":"https://api.github.com/repos/frictionlessdata/goodtables/forks","keys_url":"https://api.github.com/repos/frictionlessdata/goodtables/keys{/key_id}","collaborators_url":"https://api.github.com/repos/frictionlessdata/goodtables/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/frictionlessdata/goodtables/teams","hooks_url":"https://api.github.com/repos/frictionlessdata/goodtables/hooks","issue_events_url":"https://api.github.com/repos/frictionlessdata/goodtables/issues/events{/number}","events_url":"https://api.github.com/repos/frictionlessdata/goodtables/events","assignees_url":"https://api.github.com/repos/frictionlessdata/goodtables/assignees{/user}","branches_url":"https://api.github.com/repos/frictionlessdata/goodtables/branches{/branch}","tags_url":"https://api.github.com/repos/frictionlessdata/goodtables/tags","blobs_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/refs{/sha}","trees_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/trees{/sha}","statuses_url":"https://api.github.com/repos/frictionlessdata/goodtables/statuses/{sha}","languages_url":"https://api.github.com/repos/frictionlessdata/goodtables/languages","stargazers_url":"https://api.github.com/repos/frictionlessdata/goodtables/stargazers","contributors_url":"https://api.github.com/repos/frictionlessdata/goodtables/contributors","subscribers_url":"https://api.github.com/repos/frictionlessdata/goodtables/subscribers","subscription_url":"https://api.github.com/repos/frictionlessdata/goodtables/subscription","commits_url":"https://api.github.com/repos/frictionlessdata/goodtables/commits{/sha}","git_commits_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/commits{/sha}","comments_url":"https://api.github.com/repos/frictionlessdata/goodtables/comments{/number}","issue_comment_url":"https://api.github.com/repos/frictionlessdata/goodtables/issues/comments{/number}","contents_url":"https://api.github.com/repos/frictionlessdata/goodtables/contents/{+path}","compare_url":"https://api.github.com/repos/frictionlessdata/goodtables/compare/{base}...{head}","merges_url":"https://api.github.com/repos/frictionlessdata/goodtables/merges","archive_url":"https://api.github.com/repos/frictionlessdata/goodtables/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/frictionlessdata/goodtables/downloads","issues_url":"https://api.github.com/repos/frictionlessdata/goodtables/issues{/number}","pulls_url":"https://api.github.com/repos/frictionlessdata/goodtables/pulls{/number}","milestones_url":"https://api.github.com/repos/frictionlessdata/goodtables/milestones{/number}","notifications_url":"https://api.github.com/repos/frictionlessdata/goodtables/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/frictionlessdata/goodtables/labels{/name}","releases_url":"https://api.github.com/repos/frictionlessdata/goodtables/releases{/id}","deployments_url":"https://api.github.com/repos/frictionlessdata/goodtables/deployments","created_at":"2014-12-23T17:11:11Z","updated_at":"2016-04-16T15:53:37Z","pushed_at":"2016-05-19T05:24:41Z","git_url":"git://github.com/frictionlessdata/goodtables.git","ssh_url":"git@github.com:frictionlessdata/goodtables.git","clone_url":"https://github.com/frictionlessdata/goodtables.git","svn_url":"https://github.com/frictionlessdata/goodtables","homepage":"http://goodtables.readthedocs.org/","size":795,"stargazers_count":33,"watchers_count":33,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":false,"has_pages":false,"forks_count":9,"mirror_url":null,"open_issues_count":16,"forks":9,"open_issues":16,"watchers":33,"default_branch":"master"}},"base":{"label":"frictionlessdata:master","ref":"master","sha":"f620ecf8c67b3ba8a7f4a47ab93aa7db1e0b7b2e","user":{"login":"frictionlessdata","id":5912125,"avatar_url":"https://avatars.githubusercontent.com/u/5912125?v=3","gravatar_id":"","url":"https://api.github.com/users/frictionlessdata","html_url":"https://github.com/frictionlessdata","followers_url":"https://api.github.com/users/frictionlessdata/followers","following_url":"https://api.github.com/users/frictionlessdata/following{/other_user}","gists_url":"https://api.github.com/users/frictionlessdata/gists{/gist_id}","starred_url":"https://api.github.com/users/frictionlessdata/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/frictionlessdata/subscriptions","organizations_url":"https://api.github.com/users/frictionlessdata/orgs","repos_url":"https://api.github.com/users/frictionlessdata/repos","events_url":"https://api.github.com/users/frictionlessdata/events{/privacy}","received_events_url":"https://api.github.com/users/frictionlessdata/received_events","type":"Organization","site_admin":false},"repo":{"id":28409905,"name":"goodtables","full_name":"frictionlessdata/goodtables","owner":{"login":"frictionlessdata","id":5912125,"avatar_url":"https://avatars.githubusercontent.com/u/5912125?v=3","gravatar_id":"","url":"https://api.github.com/users/frictionlessdata","html_url":"https://github.com/frictionlessdata","followers_url":"https://api.github.com/users/frictionlessdata/followers","following_url":"https://api.github.com/users/frictionlessdata/following{/other_user}","gists_url":"https://api.github.com/users/frictionlessdata/gists{/gist_id}","starred_url":"https://api.github.com/users/frictionlessdata/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/frictionlessdata/subscriptions","organizations_url":"https://api.github.com/users/frictionlessdata/orgs","repos_url":"https://api.github.com/users/frictionlessdata/repos","events_url":"https://api.github.com/users/frictionlessdata/events{/privacy}","received_events_url":"https://api.github.com/users/frictionlessdata/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/frictionlessdata/goodtables","description":"Validate and process tabular data.","fork":false,"url":"https://api.github.com/repos/frictionlessdata/goodtables","forks_url":"https://api.github.com/repos/frictionlessdata/goodtables/forks","keys_url":"https://api.github.com/repos/frictionlessdata/goodtables/keys{/key_id}","collaborators_url":"https://api.github.com/repos/frictionlessdata/goodtables/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/frictionlessdata/goodtables/teams","hooks_url":"https://api.github.com/repos/frictionlessdata/goodtables/hooks","issue_events_url":"https://api.github.com/repos/frictionlessdata/goodtables/issues/events{/number}","events_url":"https://api.github.com/repos/frictionlessdata/goodtables/events","assignees_url":"https://api.github.com/repos/frictionlessdata/goodtables/assignees{/user}","branches_url":"https://api.github.com/repos/frictionlessdata/goodtables/branches{/branch}","tags_url":"https://api.github.com/repos/frictionlessdata/goodtables/tags","blobs_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/refs{/sha}","trees_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/trees{/sha}","statuses_url":"https://api.github.com/repos/frictionlessdata/goodtables/statuses/{sha}","languages_url":"https://api.github.com/repos/frictionlessdata/goodtables/languages","stargazers_url":"https://api.github.com/repos/frictionlessdata/goodtables/stargazers","contributors_url":"https://api.github.com/repos/frictionlessdata/goodtables/contributors","subscribers_url":"https://api.github.com/repos/frictionlessdata/goodtables/subscribers","subscription_url":"https://api.github.com/repos/frictionlessdata/goodtables/subscription","commits_url":"https://api.github.com/repos/frictionlessdata/goodtables/commits{/sha}","git_commits_url":"https://api.github.com/repos/frictionlessdata/goodtables/git/commits{/sha}","comments_url":"https://api.github.com/repos/frictionlessdata/goodtables/comments{/number}","issue_comment_url":"https://api.github.com/repos/frictionlessdata/goodtables/issues/comments{/number}","contents_url":"https://api.github.com/repos/frictionlessdata/goodtables/contents/{+path}","compare_url":"https://api.github.com/repos/frictionlessdata/goodtables/compare/{base}...{head}","merges_url":"https://api.github.com/repos/frictionlessdata/goodtables/merges","archive_url":"https://api.github.com/repos/frictionlessdata/goodtables/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/frictionlessdata/goodtables/downloads","issues_url":"https://api.github.com/repos/frictionlessdata/goodtables/issues{/number}","pulls_url":"https://api.github.com/repos/frictionlessdata/goodtables/pulls{/number}","milestones_url":"https://api.github.com/repos/frictionlessdata/goodtables/milestones{/number}","notifications_url":"https://api.github.com/repos/frictionlessdata/goodtables/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/frictionlessdata/goodtables/labels{/name}","releases_url":"https://api.github.com/repos/frictionlessdata/goodtables/releases{/id}","deployments_url":"https://api.github.com/repos/frictionlessdata/goodtables/deployments","created_at":"2014-12-23T17:11:11Z","updated_at":"2016-04-16T15:53:37Z","pushed_at":"2016-05-19T05:24:41Z","git_url":"git://github.com/frictionlessdata/goodtables.git","ssh_url":"git@github.com:frictionlessdata/goodtables.git","clone_url":"https://github.com/frictionlessdata/goodtables.git","svn_url":"https://github.com/frictionlessdata/goodtables","homepage":"http://goodtables.readthedocs.org/","size":795,"stargazers_count":33,"watchers_count":33,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":false,"has_pages":false,"forks_count":9,"mirror_url":null,"open_issues_count":16,"forks":9,"open_issues":16,"watchers":33,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/frictionlessdata/goodtables/pulls/102"},"html":{"href":"https://github.com/frictionlessdata/goodtables/pull/102"},"issue":{"href":"https://api.github.com/repos/frictionlessdata/goodtables/issues/102"},"comments":{"href":"https://api.github.com/repos/frictionlessdata/goodtables/issues/102/comments"},"review_comments":{"href":"https://api.github.com/repos/frictionlessdata/goodtables/pulls/102/comments"},"review_comment":{"href":"https://api.github.com/repos/frictionlessdata/goodtables/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/frictionlessdata/goodtables/pulls/102/commits"},"statuses":{"href":"https://api.github.com/repos/frictionlessdata/goodtables/statuses/60fd0eb450bedb424242dd077c05e27c5a1c7e91"}},"merged":true,"mergeable":null,"mergeable_state":"unknown","merged_by":{"login":"pwalsh","id":791678,"avatar_url":"https://avatars.githubusercontent.com/u/791678?v=3","gravatar_id":"","url":"https://api.github.com/users/pwalsh","html_url":"https://github.com/pwalsh","followers_url":"https://api.github.com/users/pwalsh/followers","following_url":"https://api.github.com/users/pwalsh/following{/other_user}","gists_url":"https://api.github.com/users/pwalsh/gists{/gist_id}","starred_url":"https://api.github.com/users/pwalsh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pwalsh/subscriptions","organizations_url":"https://api.github.com/users/pwalsh/orgs","repos_url":"https://api.github.com/users/pwalsh/repos","events_url":"https://api.github.com/users/pwalsh/events{/privacy}","received_events_url":"https://api.github.com/users/pwalsh/received_events","type":"User","site_admin":false},"comments":2,"review_comments":0,"commits":1,"additions":3,"deletions":3,"changed_files":2}}