{"action":"created","issue":{"url":"https://api.github.com/repos/gcr/torch-residual-networks/issues/10","repository_url":"https://api.github.com/repos/gcr/torch-residual-networks","labels_url":"https://api.github.com/repos/gcr/torch-residual-networks/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/gcr/torch-residual-networks/issues/10/comments","events_url":"https://api.github.com/repos/gcr/torch-residual-networks/issues/10/events","html_url":"https://github.com/gcr/torch-residual-networks/issues/10","id":142164894,"number":10,"title":"Loss function explode under default settings","user":{"login":"yangky11","id":5431913,"avatar_url":"https://avatars.githubusercontent.com/u/5431913?v=3","gravatar_id":"","url":"https://api.github.com/users/yangky11","html_url":"https://github.com/yangky11","followers_url":"https://api.github.com/users/yangky11/followers","following_url":"https://api.github.com/users/yangky11/following{/other_user}","gists_url":"https://api.github.com/users/yangky11/gists{/gist_id}","starred_url":"https://api.github.com/users/yangky11/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yangky11/subscriptions","organizations_url":"https://api.github.com/users/yangky11/orgs","repos_url":"https://api.github.com/users/yangky11/repos","events_url":"https://api.github.com/users/yangky11/events{/privacy}","received_events_url":"https://api.github.com/users/yangky11/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-03-20T13:40:15Z","updated_at":"2016-04-05T10:48:04Z","closed_at":null,"body":"Hi all,\r\n\r\nI'm training on CIFAR-10 following the instructions but I found that in most cases the loss function explodes during the first few iterations.  \r\nThis is how it behaved when it luckily didn't explode. I don't know whether this is the case for others, but maybe the initial learning rate 0.1 is too large?\r\n\r\n```\r\n12.243277549744\t\r\n314.09014892578.............................................. 128/50000 ................] ETA: 0ms | Step: 0ms          \r\n684.17578125................................................... 256/50000 ..............] ETA: 1m26s | Step: 1ms        \r\n1731.8382568359................................................ 384/50000 ..............] ETA: 1m40s | Step: 2ms        \r\n1436.0552978516................................................ 512/50000 ..............] ETA: 1m42s | Step: 2ms        \r\n1810.4338378906................................................ 640/50000 ..............] ETA: 1m44s | Step: 2ms        \r\n2016.3845214844................................................ 768/50000 ..............] ETA: 1m42s | Step: 2ms        \r\n1415.6356201172................................................ 896/50000 ..............] ETA: 1m43s | Step: 2ms        \r\n980.73388671875................................................ 1024/50000 .............] ETA: 1m45s | Step: 2ms        \r\n404.52484130859................................................ 1152/50000 .............] ETA: 1m44s | Step: 2ms        \r\n235.41812133789................................................ 1280/50000 .............] ETA: 1m45s | Step: 2ms        \r\n162.14950561523................................................ 1408/50000 .............] ETA: 1m43s | Step: 2ms        \r\n203.14471435547................................................ 1536/50000 .............] ETA: 1m43s | Step: 2ms        \r\n157.7633972168................................................. 1664/50000 .............] ETA: 1m43s | Step: 2ms        \r\n153.45094299316................................................ 1792/50000 .............] ETA: 1m42s | Step: 2ms        \r\n127.98012542725................................................ 1920/50000 .............] ETA: 1m42s | Step: 2ms        \r\n81.274276733398................................................ 2048/50000 .............] ETA: 1m42s | Step: 2ms        \r\n52.629417419434................................................ 2176/50000 .............] ETA: 1m42s | Step: 2ms        \r\n28.258670806885................................................ 2304/50000 .............] ETA: 1m42s | Step: 2ms        \r\n12.342067718506................................................ 2432/50000 .............] ETA: 1m42s | Step: 2ms        \r\n6.292441368103................................................. 2560/50000 .............] ETA: 1m42s | Step: 2ms        \r\n3.0711505413055................................................ 2688/50000 .............] ETA: 1m42s | Step: 2ms        \r\n2.4665925502777................................................ 2816/50000 .............] ETA: 1m42s | Step: 2ms        \r\n2.3633861541748................................................ 2944/50000 .............] ETA: 1m42s | Step: 2ms        \r\n2.3024611473083................................................ 3072/50000 .............] ETA: 1m41s | Step: 2ms        \r\n2.3726959228516................................................ 3200/50000 .............] ETA: 1m41s | Step: 2ms        \r\n2.3351118564606................................................ 3328/50000 .............] ETA: 1m41s | Step: 2ms        \r\n2.3633522987366................................................ 3456/50000 .............] ETA: 1m41s | Step: 2ms        \r\n2.3602793216705................................................ 3584/50000 .............] ETA: 1m41s | Step: 2ms        \r\n2.3885579109192................................................ 3712/50000 .............] ETA: 1m40s | Step: 2ms        \r\n2.3737788200378................................................ 3840/50000 .............] ETA: 1m40s | Step: 2ms\r\n```"},"comment":{"url":"https://api.github.com/repos/gcr/torch-residual-networks/issues/comments/205753711","html_url":"https://github.com/gcr/torch-residual-networks/issues/10#issuecomment-205753711","issue_url":"https://api.github.com/repos/gcr/torch-residual-networks/issues/10","id":205753711,"user":{"login":"hli2020","id":9053054,"avatar_url":"https://avatars.githubusercontent.com/u/9053054?v=3","gravatar_id":"","url":"https://api.github.com/users/hli2020","html_url":"https://github.com/hli2020","followers_url":"https://api.github.com/users/hli2020/followers","following_url":"https://api.github.com/users/hli2020/following{/other_user}","gists_url":"https://api.github.com/users/hli2020/gists{/gist_id}","starred_url":"https://api.github.com/users/hli2020/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hli2020/subscriptions","organizations_url":"https://api.github.com/users/hli2020/orgs","repos_url":"https://api.github.com/users/hli2020/repos","events_url":"https://api.github.com/users/hli2020/events{/privacy}","received_events_url":"https://api.github.com/users/hli2020/received_events","type":"User","site_admin":false},"created_at":"2016-04-05T10:48:04Z","updated_at":"2016-04-05T10:48:04Z","body":"got the same issue"}}