{"action":"created","issue":{"url":"https://api.github.com/repos/pcgreat/SeqMatchSeq/issues/1","repository_url":"https://api.github.com/repos/pcgreat/SeqMatchSeq","labels_url":"https://api.github.com/repos/pcgreat/SeqMatchSeq/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/pcgreat/SeqMatchSeq/issues/1/comments","events_url":"https://api.github.com/repos/pcgreat/SeqMatchSeq/issues/1/events","html_url":"https://github.com/pcgreat/SeqMatchSeq/issues/1","id":314384142,"node_id":"MDU6SXNzdWUzMTQzODQxNDI=","number":1,"title":"MAP performance on Dev ","user":{"login":"vikas95","id":25675079,"node_id":"MDQ6VXNlcjI1Njc1MDc5","avatar_url":"https://avatars2.githubusercontent.com/u/25675079?v=4","gravatar_id":"","url":"https://api.github.com/users/vikas95","html_url":"https://github.com/vikas95","followers_url":"https://api.github.com/users/vikas95/followers","following_url":"https://api.github.com/users/vikas95/following{/other_user}","gists_url":"https://api.github.com/users/vikas95/gists{/gist_id}","starred_url":"https://api.github.com/users/vikas95/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vikas95/subscriptions","organizations_url":"https://api.github.com/users/vikas95/orgs","repos_url":"https://api.github.com/users/vikas95/repos","events_url":"https://api.github.com/users/vikas95/events{/privacy}","received_events_url":"https://api.github.com/users/vikas95/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-04-15T04:15:50Z","updated_at":"2018-07-13T12:10:21Z","closed_at":null,"author_association":"NONE","body":"Hi,\r\n\r\nI am not sure if I am running the codes correctly, but I am just getting atmost 62% MAP on dev set after 10 epochs. \r\n\r\nCan you suggest me the required changes to reach ~72% MAP performance...\r\n\r\nThanks..."},"comment":{"url":"https://api.github.com/repos/pcgreat/SeqMatchSeq/issues/comments/404814913","html_url":"https://github.com/pcgreat/SeqMatchSeq/issues/1#issuecomment-404814913","issue_url":"https://api.github.com/repos/pcgreat/SeqMatchSeq/issues/1","id":404814913,"node_id":"MDEyOklzc3VlQ29tbWVudDQwNDgxNDkxMw==","user":{"login":"aneesh-joshi","id":14147383,"node_id":"MDQ6VXNlcjE0MTQ3Mzgz","avatar_url":"https://avatars2.githubusercontent.com/u/14147383?v=4","gravatar_id":"","url":"https://api.github.com/users/aneesh-joshi","html_url":"https://github.com/aneesh-joshi","followers_url":"https://api.github.com/users/aneesh-joshi/followers","following_url":"https://api.github.com/users/aneesh-joshi/following{/other_user}","gists_url":"https://api.github.com/users/aneesh-joshi/gists{/gist_id}","starred_url":"https://api.github.com/users/aneesh-joshi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aneesh-joshi/subscriptions","organizations_url":"https://api.github.com/users/aneesh-joshi/orgs","repos_url":"https://api.github.com/users/aneesh-joshi/repos","events_url":"https://api.github.com/users/aneesh-joshi/events{/privacy}","received_events_url":"https://api.github.com/users/aneesh-joshi/received_events","type":"User","site_admin":false},"created_at":"2018-07-13T12:10:21Z","updated_at":"2018-07-13T12:10:21Z","author_association":"NONE","body":"I am getting similar MAP values as @vikas95 \r\n@pcgreat \r\nQA-Transfer sounds interesting.\r\nThe 0.8 rank is quite remarkable. But does it transfer well to general scenarios?\r\n\r\nAre there any other models which might be interesting. I am looking for the \"best\" Similarity Learning model to implement. With models being unstable or non-reproducible, it's pretty hard to judge.\r\n\r\nI was able to get 0.65 MAP with the MatchPyramid model. I couldn't reproduce the [Bilateral Multi-Perspective Matching for Natural Language Sentences](https://arxiv.org/pdf/1702.03814.pdf) results."}}
{"actor":{"display_login":"aneesh-joshi"}}