{"action":"created","issue":{"url":"https://api.github.com/repos/openml/OpenML/issues/266","repository_url":"https://api.github.com/repos/openml/OpenML","labels_url":"https://api.github.com/repos/openml/OpenML/issues/266/labels{/name}","comments_url":"https://api.github.com/repos/openml/OpenML/issues/266/comments","events_url":"https://api.github.com/repos/openml/OpenML/issues/266/events","html_url":"https://github.com/openml/OpenML/issues/266","id":142359793,"number":266,"title":"syntax check of predictions","user":{"login":"TGlas","id":4291427,"avatar_url":"https://avatars.githubusercontent.com/u/4291427?v=3","gravatar_id":"","url":"https://api.github.com/users/TGlas","html_url":"https://github.com/TGlas","followers_url":"https://api.github.com/users/TGlas/followers","following_url":"https://api.github.com/users/TGlas/following{/other_user}","gists_url":"https://api.github.com/users/TGlas/gists{/gist_id}","starred_url":"https://api.github.com/users/TGlas/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/TGlas/subscriptions","organizations_url":"https://api.github.com/users/TGlas/orgs","repos_url":"https://api.github.com/users/TGlas/repos","events_url":"https://api.github.com/users/TGlas/events{/privacy}","received_events_url":"https://api.github.com/users/TGlas/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2016-03-21T14:11:28Z","updated_at":"2016-03-22T10:43:47Z","closed_at":null,"body":"When uploading a run the XML file is validated against the spec, however, the predictions file is not. Even uploading a file of a different format (maybe by accident) succeeds, and a run ID is assigned. I propose to add a simple syntax check, e.g., validating the ARFF header.\r\n"},"comment":{"url":"https://api.github.com/repos/openml/OpenML/issues/comments/199747027","html_url":"https://github.com/openml/OpenML/issues/266#issuecomment-199747027","issue_url":"https://api.github.com/repos/openml/OpenML/issues/266","id":199747027,"user":{"login":"janvanrijn","id":2292730,"avatar_url":"https://avatars.githubusercontent.com/u/2292730?v=3","gravatar_id":"","url":"https://api.github.com/users/janvanrijn","html_url":"https://github.com/janvanrijn","followers_url":"https://api.github.com/users/janvanrijn/followers","following_url":"https://api.github.com/users/janvanrijn/following{/other_user}","gists_url":"https://api.github.com/users/janvanrijn/gists{/gist_id}","starred_url":"https://api.github.com/users/janvanrijn/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/janvanrijn/subscriptions","organizations_url":"https://api.github.com/users/janvanrijn/orgs","repos_url":"https://api.github.com/users/janvanrijn/repos","events_url":"https://api.github.com/users/janvanrijn/events{/privacy}","received_events_url":"https://api.github.com/users/janvanrijn/received_events","type":"User","site_admin":false},"created_at":"2016-03-22T10:43:47Z","updated_at":"2016-03-22T10:43:47Z","body":"The way I see it, there is only one option that seems feasible, which is\noption 3.\n\nIn the past we had a Java call from PHP to check the ARFF ( dataset upload,\nrun upload),\nbut this both slowed down the server too much (which causes other runs to\nfail) and made\nthings very hard to debug.\n\nAny help with this would be greatly appreciated!\n\n\n2016-03-22 11:35 GMT+01:00 Tobias Glasmachers <notifications@github.com>:\n\n> I see the following options for checking the ARFF input:\n>\n>    - call java from php\n>    - call C/C++, say, using my C++ ARFF reader\n>    - write an ARFF reader in php, which will be slow, but checking the\n>    header and the first 10 data lines should be enough.\n>\n> Which one would you prefer? I can offer to help out with the second and\n> third option.\n>\n> —\n> You are receiving this because you commented.\n> Reply to this email directly or view it on GitHub\n> <https://github.com/openml/OpenML/issues/266#issuecomment-199744308>\n>\n"}}