{"action":"created","issue":{"url":"https://api.github.com/repos/Element-Research/rnn/issues/323","repository_url":"https://api.github.com/repos/Element-Research/rnn","labels_url":"https://api.github.com/repos/Element-Research/rnn/issues/323/labels{/name}","comments_url":"https://api.github.com/repos/Element-Research/rnn/issues/323/comments","events_url":"https://api.github.com/repos/Element-Research/rnn/issues/323/events","html_url":"https://github.com/Element-Research/rnn/issues/323","id":170961527,"number":323,"title":"Implementation Request: Layer Normalization","user":{"login":"juesato","id":5617616,"avatar_url":"https://avatars.githubusercontent.com/u/5617616?v=3","gravatar_id":"","url":"https://api.github.com/users/juesato","html_url":"https://github.com/juesato","followers_url":"https://api.github.com/users/juesato/followers","following_url":"https://api.github.com/users/juesato/following{/other_user}","gists_url":"https://api.github.com/users/juesato/gists{/gist_id}","starred_url":"https://api.github.com/users/juesato/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/juesato/subscriptions","organizations_url":"https://api.github.com/users/juesato/orgs","repos_url":"https://api.github.com/users/juesato/repos","events_url":"https://api.github.com/users/juesato/events{/privacy}","received_events_url":"https://api.github.com/users/juesato/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-08-12T21:20:45Z","updated_at":"2016-09-13T06:37:48Z","closed_at":null,"body":"I've heard promising things about [layer normalization](http://arxiv.org/pdf/1607.06450.pdf).\r\n\r\n@nicholas-leonard Do you think this is worth including? If so, I'm happy to implement this next week. Arguably it should be inside the `nn` package since it can in theory be used for non-recurrent networks as well, but my impression is that it's very useful for recurrent architectures, and not very useful for non-recurrent architectures."},"comment":{"url":"https://api.github.com/repos/Element-Research/rnn/issues/comments/246588988","html_url":"https://github.com/Element-Research/rnn/issues/323#issuecomment-246588988","issue_url":"https://api.github.com/repos/Element-Research/rnn/issues/323","id":246588988,"user":{"login":"juesato","id":5617616,"avatar_url":"https://avatars.githubusercontent.com/u/5617616?v=3","gravatar_id":"","url":"https://api.github.com/users/juesato","html_url":"https://github.com/juesato","followers_url":"https://api.github.com/users/juesato/followers","following_url":"https://api.github.com/users/juesato/following{/other_user}","gists_url":"https://api.github.com/users/juesato/gists{/gist_id}","starred_url":"https://api.github.com/users/juesato/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/juesato/subscriptions","organizations_url":"https://api.github.com/users/juesato/orgs","repos_url":"https://api.github.com/users/juesato/repos","events_url":"https://api.github.com/users/juesato/events{/privacy}","received_events_url":"https://api.github.com/users/juesato/received_events","type":"User","site_admin":false},"created_at":"2016-09-13T06:37:48Z","updated_at":"2016-09-13T06:37:48Z","body":"@iikulikov I'm surprised layer normalization has any noticeable benefit on such a shallow network. Do you still have the training plots from those experiments?"}}
{"actor":{"display_login":"juesato"}}