{"action":"created","issue":{"url":"https://api.github.com/repos/openml/OpenML/issues/508","repository_url":"https://api.github.com/repos/openml/OpenML","labels_url":"https://api.github.com/repos/openml/OpenML/issues/508/labels{/name}","comments_url":"https://api.github.com/repos/openml/OpenML/issues/508/comments","events_url":"https://api.github.com/repos/openml/OpenML/issues/508/events","html_url":"https://github.com/openml/OpenML/issues/508","id":271007424,"number":508,"title":"Dataset hash issues","user":{"login":"mfeurer","id":5320498,"avatar_url":"https://avatars2.githubusercontent.com/u/5320498?v=4","gravatar_id":"","url":"https://api.github.com/users/mfeurer","html_url":"https://github.com/mfeurer","followers_url":"https://api.github.com/users/mfeurer/followers","following_url":"https://api.github.com/users/mfeurer/following{/other_user}","gists_url":"https://api.github.com/users/mfeurer/gists{/gist_id}","starred_url":"https://api.github.com/users/mfeurer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mfeurer/subscriptions","organizations_url":"https://api.github.com/users/mfeurer/orgs","repos_url":"https://api.github.com/users/mfeurer/repos","events_url":"https://api.github.com/users/mfeurer/events{/privacy}","received_events_url":"https://api.github.com/users/mfeurer/received_events","type":"User","site_admin":false},"labels":[{"id":21832135,"url":"https://api.github.com/repos/openml/OpenML/labels/bug","name":"bug","color":"fc2929","default":true},{"id":49175880,"url":"https://api.github.com/repos/openml/OpenML/labels/priority:%20highest","name":"priority: highest","color":"e11d21","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":15,"created_at":"2017-11-03T14:58:42Z","updated_at":"2018-05-26T23:32:13Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"I realized that some datasets have issues with their md5 hash. Check for example:\r\n```bash\r\nwget https://www.openml.org/data/v1/download/61/iris.arff && md5sum iris.arff\r\nwget https://www.openml.org/api/v1/data/61 && cat 61 | grep md5_checksum\r\n```\r\nshowing that either the md5 checksum for the dataset, or the dataset is broken.\r\n\r\nOverall, 19 datasets have this problem in total: 61, 250, 252, 299, 310, 311, 316, 537, 543, 1029, 1547, 1548, 1549, 1551, 1552, 1553, 1554, 1555, 4546"},"comment":{"url":"https://api.github.com/repos/openml/OpenML/issues/comments/392294535","html_url":"https://github.com/openml/OpenML/issues/508#issuecomment-392294535","issue_url":"https://api.github.com/repos/openml/OpenML/issues/508","id":392294535,"user":{"login":"joaquinvanschoren","id":1724503,"avatar_url":"https://avatars1.githubusercontent.com/u/1724503?v=4","gravatar_id":"","url":"https://api.github.com/users/joaquinvanschoren","html_url":"https://github.com/joaquinvanschoren","followers_url":"https://api.github.com/users/joaquinvanschoren/followers","following_url":"https://api.github.com/users/joaquinvanschoren/following{/other_user}","gists_url":"https://api.github.com/users/joaquinvanschoren/gists{/gist_id}","starred_url":"https://api.github.com/users/joaquinvanschoren/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joaquinvanschoren/subscriptions","organizations_url":"https://api.github.com/users/joaquinvanschoren/orgs","repos_url":"https://api.github.com/users/joaquinvanschoren/repos","events_url":"https://api.github.com/users/joaquinvanschoren/events{/privacy}","received_events_url":"https://api.github.com/users/joaquinvanschoren/received_events","type":"User","site_admin":false},"created_at":"2018-05-26T23:32:12Z","updated_at":"2018-05-26T23:32:12Z","author_association":"CONTRIBUTOR","body":"Btw, I fixed all files with unknown encoding on the server. I also\nconverted most Latin-1 files, except those with string data.\nOn Sun, 27 May 2018 at 01:28, Joaquin Vanschoren <\njoaquin.vanschoren@gmail.com> wrote:\n\n> Looks like you need to tell the md5 lib which encoding the file has:\n>\n>\n> https://stackoverflow.com/questions/41068617/python-2-vs-3-same-inputs-different-results-md5-hash\n>\n>\n> https://stackoverflow.com/questions/24766220/hashlib-md5-in-python-returning-incorrect-digests-for-some-unicode-characters\n>\n> Otherwise the hash may be different from the hash computed on the server.\n> On Sun, 27 May 2018 at 01:13, janvanrijn <notifications@github.com> wrote:\n>\n>> Before replying, I have to admin that I have very limited knowledge about\n>> text encoding and how different systems handle this.\n>>\n>> the python md5 hash is somehow different from what linux does.\n>>\n>> Do we know it's python that does something else? or the specific client\n>> system (OSX I assume)?\n>>\n>> Is the best solution to say 'sorry we don't handle latin-1 encoding'?\n>>\n>> Currently, the problem is to be solved by either the person who wants to\n>> download the dataset or us. I think that it is better to hand this problem\n>> to the person who wants to upload the dataset\n>>\n>> —\n>> You are receiving this because you commented.\n>>\n>>\n>> Reply to this email directly, view it on GitHub\n>> <https://github.com/openml/OpenML/issues/508#issuecomment-392293795>, or mute\n>> the thread\n>> <https://github.com/notifications/unsubscribe-auth/ABpQVyCabJxrzUS7z4FkpxndcfyxjRtNks5t2eGRgaJpZM4QRNrj>\n>> .\n>>\n> --\n> Thank you,\n> Joaquin\n>\n-- \nThank you,\nJoaquin\n"}}
{"actor":{"display_login":"joaquinvanschoren"}}