{"action":"created","issue":{"url":"https://api.github.com/repos/tflearn/tflearn/issues/134","repository_url":"https://api.github.com/repos/tflearn/tflearn","labels_url":"https://api.github.com/repos/tflearn/tflearn/issues/134/labels{/name}","comments_url":"https://api.github.com/repos/tflearn/tflearn/issues/134/comments","events_url":"https://api.github.com/repos/tflearn/tflearn/issues/134/events","html_url":"https://github.com/tflearn/tflearn/pull/134","id":159217211,"number":134,"title":"Added stronger negative init bias to highway layers","user":{"login":"TylerBalsam","id":6165535,"avatar_url":"https://avatars.githubusercontent.com/u/6165535?v=3","gravatar_id":"","url":"https://api.github.com/users/TylerBalsam","html_url":"https://github.com/TylerBalsam","followers_url":"https://api.github.com/users/TylerBalsam/followers","following_url":"https://api.github.com/users/TylerBalsam/following{/other_user}","gists_url":"https://api.github.com/users/TylerBalsam/gists{/gist_id}","starred_url":"https://api.github.com/users/TylerBalsam/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/TylerBalsam/subscriptions","organizations_url":"https://api.github.com/users/TylerBalsam/orgs","repos_url":"https://api.github.com/users/TylerBalsam/repos","events_url":"https://api.github.com/users/TylerBalsam/events{/privacy}","received_events_url":"https://api.github.com/users/TylerBalsam/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-06-08T16:53:34Z","updated_at":"2016-06-09T06:01:21Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/tflearn/tflearn/pulls/134","html_url":"https://github.com/tflearn/tflearn/pull/134","diff_url":"https://github.com/tflearn/tflearn/pull/134.diff","patch_url":"https://github.com/tflearn/tflearn/pull/134.patch"},"body":"Bias was -1, bumped to -3. As per http://arxiv.org/pdf/1505.00387.pdf in section 2.2, paragraph 2. Since TFLearn is supposed to be more hands off, I believe a stronger bias towards carry behavior would be more forgiving at the potential cost of longer train times to overcome the negative bias."},"comment":{"url":"https://api.github.com/repos/tflearn/tflearn/issues/comments/224807221","html_url":"https://github.com/tflearn/tflearn/pull/134#issuecomment-224807221","issue_url":"https://api.github.com/repos/tflearn/tflearn/issues/134","id":224807221,"user":{"login":"aymericdamien","id":10386605,"avatar_url":"https://avatars.githubusercontent.com/u/10386605?v=3","gravatar_id":"","url":"https://api.github.com/users/aymericdamien","html_url":"https://github.com/aymericdamien","followers_url":"https://api.github.com/users/aymericdamien/followers","following_url":"https://api.github.com/users/aymericdamien/following{/other_user}","gists_url":"https://api.github.com/users/aymericdamien/gists{/gist_id}","starred_url":"https://api.github.com/users/aymericdamien/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aymericdamien/subscriptions","organizations_url":"https://api.github.com/users/aymericdamien/orgs","repos_url":"https://api.github.com/users/aymericdamien/repos","events_url":"https://api.github.com/users/aymericdamien/events{/privacy}","received_events_url":"https://api.github.com/users/aymericdamien/received_events","type":"User","site_admin":false},"created_at":"2016-06-09T06:01:21Z","updated_at":"2016-06-09T06:01:21Z","body":"I agree, most important is that our layers have a good scalability and can be re-used in other cases, thanks for pointing that out."}}
{"actor":{"display_login":"aymericdamien"}}