{"action":"created","issue":{"url":"https://api.github.com/repos/chainer/chainer/issues/4546","repository_url":"https://api.github.com/repos/chainer/chainer","labels_url":"https://api.github.com/repos/chainer/chainer/issues/4546/labels{/name}","comments_url":"https://api.github.com/repos/chainer/chainer/issues/4546/comments","events_url":"https://api.github.com/repos/chainer/chainer/issues/4546/events","html_url":"https://github.com/chainer/chainer/issues/4546","id":309973653,"node_id":"MDU6SXNzdWUzMDk5NzM2NTM=","number":4546,"title":"Add extra support for different learning rate policy.","user":{"login":"jinjiren","id":8536399,"node_id":"MDQ6VXNlcjg1MzYzOTk=","avatar_url":"https://avatars0.githubusercontent.com/u/8536399?v=4","gravatar_id":"","url":"https://api.github.com/users/jinjiren","html_url":"https://github.com/jinjiren","followers_url":"https://api.github.com/users/jinjiren/followers","following_url":"https://api.github.com/users/jinjiren/following{/other_user}","gists_url":"https://api.github.com/users/jinjiren/gists{/gist_id}","starred_url":"https://api.github.com/users/jinjiren/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jinjiren/subscriptions","organizations_url":"https://api.github.com/users/jinjiren/orgs","repos_url":"https://api.github.com/users/jinjiren/repos","events_url":"https://api.github.com/users/jinjiren/events{/privacy}","received_events_url":"https://api.github.com/users/jinjiren/received_events","type":"User","site_admin":false},"labels":[{"id":222603817,"node_id":"MDU6TGFiZWwyMjI2MDM4MTc=","url":"https://api.github.com/repos/chainer/chainer/labels/cat:feature","name":"cat:feature","color":"fbca04","default":false},{"id":388775046,"node_id":"MDU6TGFiZWwzODg3NzUwNDY=","url":"https://api.github.com/repos/chainer/chainer/labels/contribution-welcome","name":"contribution-welcome","color":"c2e0c6","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-03-30T04:40:48Z","updated_at":"2018-12-26T04:58:48Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"To reproduce results of other papers, usually we would like to follow exactly the same implementation details reported in their paper (or code, if available). However, the support for the learning rate policy in Chainer is not enough, compared with other frameworks, e.g., Caffe has many learning rate policies:\r\n```\r\n//    - fixed: always return base_lr.  \r\n//    - step: return base_lr * gamma ^ (floor(iter / step))  \r\n//    - exp: return base_lr * gamma ^ iter  \r\n//    - inv: return base_lr * (1 + gamma * iter) ^ (- power)  \r\n//    - multistep: similar to step but it allows non uniform steps defined by  \r\n//      stepvalue  \r\n//    - poly: the effective learning rate follows a polynomial decay, to be  \r\n//      zero by the max_iter. return base_lr (1 - iter/max_iter) ^ (power)  \r\n//    - sigmoid: the effective learning rate follows a sigmod decay  \r\n//      return base_lr ( 1/(1 + exp(-gamma * (iter - stepsize))))  \r\n```\r\n\r\nSince Chainer now only supports `ExponentialShift` and `LinearShift`, it is not so convenient to tune the learning rate policy (without writing custom `Trainer` hooks or updaters). IMO, providing common learning rate policy is deserved to be included in the official implementation. \r\n\r\nI would like to submit PRs for implementing some of the above policies if possible."},"comment":{"url":"https://api.github.com/repos/chainer/chainer/issues/comments/449903861","html_url":"https://github.com/chainer/chainer/issues/4546#issuecomment-449903861","issue_url":"https://api.github.com/repos/chainer/chainer/issues/4546","id":449903861,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0OTkwMzg2MQ==","user":{"login":"stale[bot]","id":26384082,"node_id":"MDM6Qm90MjYzODQwODI=","avatar_url":"https://avatars3.githubusercontent.com/in/1724?v=4","gravatar_id":"","url":"https://api.github.com/users/stale%5Bbot%5D","html_url":"https://github.com/apps/stale","followers_url":"https://api.github.com/users/stale%5Bbot%5D/followers","following_url":"https://api.github.com/users/stale%5Bbot%5D/following{/other_user}","gists_url":"https://api.github.com/users/stale%5Bbot%5D/gists{/gist_id}","starred_url":"https://api.github.com/users/stale%5Bbot%5D/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/stale%5Bbot%5D/subscriptions","organizations_url":"https://api.github.com/users/stale%5Bbot%5D/orgs","repos_url":"https://api.github.com/users/stale%5Bbot%5D/repos","events_url":"https://api.github.com/users/stale%5Bbot%5D/events{/privacy}","received_events_url":"https://api.github.com/users/stale%5Bbot%5D/received_events","type":"Bot","site_admin":false},"created_at":"2018-12-26T04:58:48Z","updated_at":"2018-12-26T04:58:48Z","author_association":"NONE","body":"This issue has been automatically marked as stale because it has not had recent activity. It will be closed after 30 days if no further activity occurs. Thank you for your contributions.\n"}}
{"actor":{"display_login":"stale"}}