{"action":"created","issue":{"url":"https://api.github.com/repos/rajpurkar/SQuAD-explorer/issues/4","repository_url":"https://api.github.com/repos/rajpurkar/SQuAD-explorer","labels_url":"https://api.github.com/repos/rajpurkar/SQuAD-explorer/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/rajpurkar/SQuAD-explorer/issues/4/comments","events_url":"https://api.github.com/repos/rajpurkar/SQuAD-explorer/issues/4/events","html_url":"https://github.com/rajpurkar/SQuAD-explorer/issues/4","id":338412189,"node_id":"MDU6SXNzdWUzMzg0MTIxODk=","number":4,"title":"Evaluation results are missing in out-v1.1.json","user":{"login":"intfloat","id":3329806,"node_id":"MDQ6VXNlcjMzMjk4MDY=","avatar_url":"https://avatars3.githubusercontent.com/u/3329806?v=4","gravatar_id":"","url":"https://api.github.com/users/intfloat","html_url":"https://github.com/intfloat","followers_url":"https://api.github.com/users/intfloat/followers","following_url":"https://api.github.com/users/intfloat/following{/other_user}","gists_url":"https://api.github.com/users/intfloat/gists{/gist_id}","starred_url":"https://api.github.com/users/intfloat/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/intfloat/subscriptions","organizations_url":"https://api.github.com/users/intfloat/orgs","repos_url":"https://api.github.com/users/intfloat/repos","events_url":"https://api.github.com/users/intfloat/events{/privacy}","received_events_url":"https://api.github.com/users/intfloat/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-07-05T03:01:55Z","updated_at":"2018-07-10T05:50:52Z","closed_at":"2018-07-10T05:50:52Z","author_association":"NONE","body":"Hi, @rajpurkar @robinjia \r\n\r\nIn the file out-v1.1.json of master branch, I notice that two bundles [0x3252d4eb0a98413d8a41d47194273184](https://github.com/rajpurkar/SQuAD-explorer/blob/master/out-v1.1.json#L14222) and [0xf01b48802be74ffaafb123df13063c51](https://github.com/rajpurkar/SQuAD-explorer/blob/master/out-v1.1.json#L13740) actually finished running successfully but the scores are null.\r\n\r\nThe result for the bundle 0x3252d4eb0a98413d8a41d47194273184 is \r\n`{\"f1\":89.22391504017472, \"exact_match\": 83.12178747508653}` \r\nas shown in https://worksheets.codalab.org/bundles/0x3252d4eb0a98413d8a41d47194273184/; \r\n\r\nAnd the result for the bundle 0xf01b48802be74ffaafb123df13063c51 is\r\n`{\"f1\":89.79569137609076, \"exact_match\": 83.98195741109829}` \r\nas shown in https://worksheets.codalab.org/bundles/0xf01b48802be74ffaafb123df13063c51/ ;\r\n\r\nCan you please take a minute and fix this issue?\r\n\r\nThanks."},"comment":{"url":"https://api.github.com/repos/rajpurkar/SQuAD-explorer/issues/comments/403708299","html_url":"https://github.com/rajpurkar/SQuAD-explorer/issues/4#issuecomment-403708299","issue_url":"https://api.github.com/repos/rajpurkar/SQuAD-explorer/issues/4","id":403708299,"node_id":"MDEyOklzc3VlQ29tbWVudDQwMzcwODI5OQ==","user":{"login":"intfloat","id":3329806,"node_id":"MDQ6VXNlcjMzMjk4MDY=","avatar_url":"https://avatars3.githubusercontent.com/u/3329806?v=4","gravatar_id":"","url":"https://api.github.com/users/intfloat","html_url":"https://github.com/intfloat","followers_url":"https://api.github.com/users/intfloat/followers","following_url":"https://api.github.com/users/intfloat/following{/other_user}","gists_url":"https://api.github.com/users/intfloat/gists{/gist_id}","starred_url":"https://api.github.com/users/intfloat/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/intfloat/subscriptions","organizations_url":"https://api.github.com/users/intfloat/orgs","repos_url":"https://api.github.com/users/intfloat/repos","events_url":"https://api.github.com/users/intfloat/events{/privacy}","received_events_url":"https://api.github.com/users/intfloat/received_events","type":"User","site_admin":false},"created_at":"2018-07-10T05:50:52Z","updated_at":"2018-07-10T05:50:52Z","author_association":"NONE","body":"Problem solved, thanks!"}}
{"actor":{"display_login":"intfloat"}}