{"action":"created","issue":{"url":"https://api.github.com/repos/shehzaadzd/MINERVA/issues/17","repository_url":"https://api.github.com/repos/shehzaadzd/MINERVA","labels_url":"https://api.github.com/repos/shehzaadzd/MINERVA/issues/17/labels{/name}","comments_url":"https://api.github.com/repos/shehzaadzd/MINERVA/issues/17/comments","events_url":"https://api.github.com/repos/shehzaadzd/MINERVA/issues/17/events","html_url":"https://github.com/shehzaadzd/MINERVA/issues/17","id":344896663,"node_id":"MDU6SXNzdWUzNDQ4OTY2NjM=","number":17,"title":"Reproduce WN18RR results","user":{"login":"FredericGodin","id":2478884,"node_id":"MDQ6VXNlcjI0Nzg4ODQ=","avatar_url":"https://avatars2.githubusercontent.com/u/2478884?v=4","gravatar_id":"","url":"https://api.github.com/users/FredericGodin","html_url":"https://github.com/FredericGodin","followers_url":"https://api.github.com/users/FredericGodin/followers","following_url":"https://api.github.com/users/FredericGodin/following{/other_user}","gists_url":"https://api.github.com/users/FredericGodin/gists{/gist_id}","starred_url":"https://api.github.com/users/FredericGodin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FredericGodin/subscriptions","organizations_url":"https://api.github.com/users/FredericGodin/orgs","repos_url":"https://api.github.com/users/FredericGodin/repos","events_url":"https://api.github.com/users/FredericGodin/events{/privacy}","received_events_url":"https://api.github.com/users/FredericGodin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2018-07-26T15:35:54Z","updated_at":"2018-07-30T17:40:45Z","closed_at":null,"author_association":"NONE","body":"I am trying to reproduce the results of WN18RR.\r\nI obtain much lower results despite using the predefined configs.\r\n\r\nINFO:root:Hits@1:  0.3500\r\n07/26/2018 02:40:17 PM: [ Hits@1:  0.3500 ]\r\nINFO:root:Hits@3:  0.4346\r\n07/26/2018 02:40:17 PM: [ Hits@3:  0.4346 ]\r\n\r\nIn the paper Hits@1 is 0.413 and Hits@3 0.456\r\n\r\nMoreover, in a new paper they are claiming a sota result compared to these lower results which makes this very confusing...\r\nhttps://arxiv.org/pdf/1802.04394.pdf"},"comment":{"url":"https://api.github.com/repos/shehzaadzd/MINERVA/issues/comments/408948718","html_url":"https://github.com/shehzaadzd/MINERVA/issues/17#issuecomment-408948718","issue_url":"https://api.github.com/repos/shehzaadzd/MINERVA/issues/17","id":408948718,"node_id":"MDEyOklzc3VlQ29tbWVudDQwODk0ODcxOA==","user":{"login":"shehzaadzd","id":4716773,"node_id":"MDQ6VXNlcjQ3MTY3NzM=","avatar_url":"https://avatars2.githubusercontent.com/u/4716773?v=4","gravatar_id":"","url":"https://api.github.com/users/shehzaadzd","html_url":"https://github.com/shehzaadzd","followers_url":"https://api.github.com/users/shehzaadzd/followers","following_url":"https://api.github.com/users/shehzaadzd/following{/other_user}","gists_url":"https://api.github.com/users/shehzaadzd/gists{/gist_id}","starred_url":"https://api.github.com/users/shehzaadzd/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shehzaadzd/subscriptions","organizations_url":"https://api.github.com/users/shehzaadzd/orgs","repos_url":"https://api.github.com/users/shehzaadzd/repos","events_url":"https://api.github.com/users/shehzaadzd/events{/privacy}","received_events_url":"https://api.github.com/users/shehzaadzd/received_events","type":"User","site_admin":false},"created_at":"2018-07-30T17:40:45Z","updated_at":"2018-07-30T17:40:45Z","author_association":"OWNER","body":"Can you give me the hyperparameters you ran the code with? "}}
{"actor":{"display_login":"shehzaadzd"}}