{"action":"created","issue":{"url":"https://api.github.com/repos/openml/OpenML/issues/268","repository_url":"https://api.github.com/repos/openml/OpenML","labels_url":"https://api.github.com/repos/openml/OpenML/issues/268/labels{/name}","comments_url":"https://api.github.com/repos/openml/OpenML/issues/268/comments","events_url":"https://api.github.com/repos/openml/OpenML/issues/268/events","html_url":"https://github.com/openml/OpenML/issues/268","id":142607302,"number":268,"title":"Compress return of APIs to allow faster serving of files","user":{"login":"mfeurer","id":5320498,"avatar_url":"https://avatars.githubusercontent.com/u/5320498?v=3","gravatar_id":"","url":"https://api.github.com/users/mfeurer","html_url":"https://github.com/mfeurer","followers_url":"https://api.github.com/users/mfeurer/followers","following_url":"https://api.github.com/users/mfeurer/following{/other_user}","gists_url":"https://api.github.com/users/mfeurer/gists{/gist_id}","starred_url":"https://api.github.com/users/mfeurer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mfeurer/subscriptions","organizations_url":"https://api.github.com/users/mfeurer/orgs","repos_url":"https://api.github.com/users/mfeurer/repos","events_url":"https://api.github.com/users/mfeurer/events{/privacy}","received_events_url":"https://api.github.com/users/mfeurer/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":21,"created_at":"2016-03-22T10:28:50Z","updated_at":"2016-08-09T11:08:22Z","closed_at":null,"body":"On my machine, it curretly takes ~60 seconds to load result of `task/list`. Half of that time is spent receiving the json file from the server, this are approx. 10MB. By zipping it, I was able to reduce it to 1.1MB, so there is a lof of redundancy. Thus, I assume that enabling http compression could speed up the API calls. Would something like this be possible from the server side?"},"comment":{"url":"https://api.github.com/repos/openml/OpenML/issues/comments/238522218","html_url":"https://github.com/openml/OpenML/issues/268#issuecomment-238522218","issue_url":"https://api.github.com/repos/openml/OpenML/issues/268","id":238522218,"user":{"login":"joaquinvanschoren","id":1724503,"avatar_url":"https://avatars.githubusercontent.com/u/1724503?v=3","gravatar_id":"","url":"https://api.github.com/users/joaquinvanschoren","html_url":"https://github.com/joaquinvanschoren","followers_url":"https://api.github.com/users/joaquinvanschoren/followers","following_url":"https://api.github.com/users/joaquinvanschoren/following{/other_user}","gists_url":"https://api.github.com/users/joaquinvanschoren/gists{/gist_id}","starred_url":"https://api.github.com/users/joaquinvanschoren/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joaquinvanschoren/subscriptions","organizations_url":"https://api.github.com/users/joaquinvanschoren/orgs","repos_url":"https://api.github.com/users/joaquinvanschoren/repos","events_url":"https://api.github.com/users/joaquinvanschoren/events{/privacy}","received_events_url":"https://api.github.com/users/joaquinvanschoren/received_events","type":"User","site_admin":false},"created_at":"2016-08-09T11:08:22Z","updated_at":"2016-08-09T11:08:22Z","body":"Sorry, I wanted to cancel my earlier response because it was obviously\nstupid, but it was sent already :)\n\nI also thought I could easily enable this, but it took me a few hours. It\nnow works (try it).\n\nHowever, there are a few caveats:\n* It only works if the dataset file returned by the server actually has an\n.arff extension. Some datasets still(?) have an auto-generated name like\nphp13ggh, I need to see how to fix that. In any case, I expect that we will\nfix this server-side soon.\n* I made it work by changing the mime-type in the header set by the server\nfor dataset downloads. It used to be application/octet-stream, now it is\ntext/plain for all arff files. For some reason apache doesn't want to\ncompress octet-streams. I need to talk to Jan to see if there is any reason\nwhy the mime-type used to be octet-stream. If there is a good reason for\nthat, I may have to revert and find another solution to compress the\ndatasets.\n\nCheers,\nJoaquin\n\n\n\nOn Mon, Aug 8, 2016 at 5:28 PM Matthias Feurer <notifications@github.com>\nwrote:\n\n> Yes, the library I'm using sends this flag by default for all requests.\n>\n> —\n> You are receiving this because you commented.\n> Reply to this email directly, view it on GitHub\n> <https://github.com/openml/OpenML/issues/268#issuecomment-238273483>, or mute\n> the thread\n> <https://github.com/notifications/unsubscribe-auth/ABpQV7x4q2FMeb7D0fqmfQ6PygmWCdXYks5qd0r8gaJpZM4H19lf>\n> .\n>\n"}}
{"actor":{"display_login":"joaquinvanschoren"}}