{"action":"created","issue":{"url":"https://api.github.com/repos/arXivTimes/arXivTimes/issues/1055","repository_url":"https://api.github.com/repos/arXivTimes/arXivTimes","labels_url":"https://api.github.com/repos/arXivTimes/arXivTimes/issues/1055/labels{/name}","comments_url":"https://api.github.com/repos/arXivTimes/arXivTimes/issues/1055/comments","events_url":"https://api.github.com/repos/arXivTimes/arXivTimes/issues/1055/events","html_url":"https://github.com/arXivTimes/arXivTimes/issues/1055","id":395434927,"node_id":"MDU6SXNzdWUzOTU0MzQ5Mjc=","number":1055,"title":"Looking for ELMo's friends: Sentence-Level Pretraining Beyond Language Modeling","user":{"login":"icoxfog417","id":544269,"node_id":"MDQ6VXNlcjU0NDI2OQ==","avatar_url":"https://avatars0.githubusercontent.com/u/544269?v=4","gravatar_id":"","url":"https://api.github.com/users/icoxfog417","html_url":"https://github.com/icoxfog417","followers_url":"https://api.github.com/users/icoxfog417/followers","following_url":"https://api.github.com/users/icoxfog417/following{/other_user}","gists_url":"https://api.github.com/users/icoxfog417/gists{/gist_id}","starred_url":"https://api.github.com/users/icoxfog417/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/icoxfog417/subscriptions","organizations_url":"https://api.github.com/users/icoxfog417/orgs","repos_url":"https://api.github.com/users/icoxfog417/repos","events_url":"https://api.github.com/users/icoxfog417/events{/privacy}","received_events_url":"https://api.github.com/users/icoxfog417/received_events","type":"User","site_admin":false},"labels":[{"id":469035230,"node_id":"MDU6TGFiZWw0NjkwMzUyMzA=","url":"https://api.github.com/repos/arXivTimes/arXivTimes/labels/DataRepresentation","name":"DataRepresentation","color":"fffafa","default":false},{"id":469035227,"node_id":"MDU6TGFiZWw0NjkwMzUyMjc=","url":"https://api.github.com/repos/arXivTimes/arXivTimes/labels/NLP","name":"NLP","color":"c2e0c6","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2019-01-03T01:46:18Z","updated_at":"2019-01-03T01:50:07Z","closed_at":null,"author_association":"MEMBER","body":"## 一言でいうと\r\n\r\n自然言語処理においてどんな事前学習が有効か調べた研究。ELMoの構造をベースに、文の意味理解に関する9つのタスクを集めたGLUEを始め様々なタスクで事前学習を行い性能を評価している。結果は言語モデルが優秀で、マルチタスクについては対象タスクとの相性があるよう\r\n\r\n### 論文リンク\r\n\r\nhttps://arxiv.org/abs/1812.10860\r\n\r\n### 著者/所属機関\r\n\r\nSamuel R. Bowman, Ellie Pavlick, Edouard Grave, Benjamin Van Durme, Alex Wang, Jan Hula, Patrick Xia, Raghavendra Pappagari, R. Thomas McCoy, Roma Patel, Najoung Kim, Ian Tenney, Yinghui Huang, Katherin Yu, Shuning Jin, Berlin Chen\r\n\r\n* New York University\r\n* Brown University\r\n* Google AI Language\r\n* Facebook,\r\n* Johns Hopkins University\r\n* IBM\r\n* University of Minnesota Duluth\r\n* Swarthmore College\r\n\r\n### 投稿日付(yyyy/MM/dd)\r\n\r\n2018/12/28\r\n\r\n## 概要\r\n\r\n## 新規性・差分\r\n\r\n## 手法\r\n\r\n## 結果\r\n\r\n## コメント\r\n\r\n#1048 と似ている研究。"},"comment":{"url":"https://api.github.com/repos/arXivTimes/arXivTimes/issues/comments/451038165","html_url":"https://github.com/arXivTimes/arXivTimes/issues/1055#issuecomment-451038165","issue_url":"https://api.github.com/repos/arXivTimes/arXivTimes/issues/1055","id":451038165,"node_id":"MDEyOklzc3VlQ29tbWVudDQ1MTAzODE2NQ==","user":{"login":"icoxfog417","id":544269,"node_id":"MDQ6VXNlcjU0NDI2OQ==","avatar_url":"https://avatars0.githubusercontent.com/u/544269?v=4","gravatar_id":"","url":"https://api.github.com/users/icoxfog417","html_url":"https://github.com/icoxfog417","followers_url":"https://api.github.com/users/icoxfog417/followers","following_url":"https://api.github.com/users/icoxfog417/following{/other_user}","gists_url":"https://api.github.com/users/icoxfog417/gists{/gist_id}","starred_url":"https://api.github.com/users/icoxfog417/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/icoxfog417/subscriptions","organizations_url":"https://api.github.com/users/icoxfog417/orgs","repos_url":"https://api.github.com/users/icoxfog417/repos","events_url":"https://api.github.com/users/icoxfog417/events{/privacy}","received_events_url":"https://api.github.com/users/icoxfog417/received_events","type":"User","site_admin":false},"created_at":"2019-01-03T01:50:07Z","updated_at":"2019-01-03T01:50:07Z","author_association":"MEMBER","body":"実装に[AllenNLP](https://github.com/allenai/allennlp)、学習に[jiant](https://github.com/jsalt18-sentence-repl/jiant)、評価は[GLUE](https://gluebenchmark.com/)というかなりモダンな研究。[Rejectの理由](https://openreview.net/forum?id=Bkl87h09FX)はちょっとかわいそうだが、落としたくなる理由もちょっとわかる。調査結果だけでWhyに関する分析があまりなかったのが要因かなと思う。\r\n"}}
{"actor":{"display_login":"icoxfog417"}}