{"action":"created","issue":{"url":"https://api.github.com/repos/DeepScale/SqueezeNet/issues/3","repository_url":"https://api.github.com/repos/DeepScale/SqueezeNet","labels_url":"https://api.github.com/repos/DeepScale/SqueezeNet/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/DeepScale/SqueezeNet/issues/3/comments","events_url":"https://api.github.com/repos/DeepScale/SqueezeNet/issues/3/events","html_url":"https://github.com/DeepScale/SqueezeNet/issues/3","id":137089609,"number":3,"title":"SqueezeNet benchmark","user":{"login":"ducha-aiki","id":4803565,"avatar_url":"https://avatars.githubusercontent.com/u/4803565?v=3","gravatar_id":"","url":"https://api.github.com/users/ducha-aiki","html_url":"https://github.com/ducha-aiki","followers_url":"https://api.github.com/users/ducha-aiki/followers","following_url":"https://api.github.com/users/ducha-aiki/following{/other_user}","gists_url":"https://api.github.com/users/ducha-aiki/gists{/gist_id}","starred_url":"https://api.github.com/users/ducha-aiki/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ducha-aiki/subscriptions","organizations_url":"https://api.github.com/users/ducha-aiki/orgs","repos_url":"https://api.github.com/users/ducha-aiki/repos","events_url":"https://api.github.com/users/ducha-aiki/events{/privacy}","received_events_url":"https://api.github.com/users/ducha-aiki/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2016-02-28T19:59:05Z","updated_at":"2016-03-22T13:34:21Z","closed_at":null,"body":"Hi,\r\n\r\nSqueezeNet is really cool architecture! I have added it to my caffenet-variants benchmark and it looks even better than caffenet.\r\nhttps://github.com/ducha-aiki/caffenet-benchmark/blob/master/Architectures.md\r\n\r\n| Name    | Accuracy      | LogLoss | Comments  |\r\n| -------|---------:| -------:|:-----------|\r\n| [CaffeNet128-2048](http://arxiv.org/abs/1408.5093) |0.470| 2.36 | Pool5 = 3x3,fc6-fc7=2048|\r\n| [CaffeNet128-4096](http://arxiv.org/abs/1408.5093) |0.497| 2.24 | Pool5 = 3x3, fc6-fc7=4096|\r\n| [SqueezeNet128](https://github.com/DeepScale/SqueezeNet) | 0.530 | 2.08 | Reference SqueezeNet solver, but linear lr_policy and batch_size=256 (320K iters)|\r\n| SqueezeNet128+ELU | **0.555** | **1.95** | Reference solver, but linear lr_policy and batch_size=256 (320K iters).ELU|\r\n\r\n\r\nNote, that because of speed reasons, I use image size = 128 px, so performances of all nets are degraded compared to classical 227px.\r\n\r\nI`d like to suggest a bit different solver setup for SqueezeNet. \r\nAccording to my tests on caffenet128, linear lr_policy works better, than squared, as in your solver:\r\nhttps://github.com/ducha-aiki/caffenet-benchmark/blob/master/Lr_policy.md\r\n\r\n| Name    | Accuracy      | LogLoss | Comments  |\r\n| -------|---------:| -------:|:-----------|\r\n| Step 100K |0.470| 2.36 | Default caffenet solver, max_iter=320K |\r\n| Poly lr, p=0.5, sqrt |0.483| 2.29 | bvlc_quick_googlenet_solver, All the way worse than \"step\", leading at finish |\r\n| Poly lr, p=2.0, sqr |0.483| 2.299 | |\r\n| Poly lr, p=1.0, linear |**0.493**|***2.24*** | |\r\n\r\n--\r\nBest regards, Dmytro. "},"comment":{"url":"https://api.github.com/repos/DeepScale/SqueezeNet/issues/comments/199816383","html_url":"https://github.com/DeepScale/SqueezeNet/issues/3#issuecomment-199816383","issue_url":"https://api.github.com/repos/DeepScale/SqueezeNet/issues/3","id":199816383,"user":{"login":"gaush123","id":7630358,"avatar_url":"https://avatars.githubusercontent.com/u/7630358?v=3","gravatar_id":"","url":"https://api.github.com/users/gaush123","html_url":"https://github.com/gaush123","followers_url":"https://api.github.com/users/gaush123/followers","following_url":"https://api.github.com/users/gaush123/following{/other_user}","gists_url":"https://api.github.com/users/gaush123/gists{/gist_id}","starred_url":"https://api.github.com/users/gaush123/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gaush123/subscriptions","organizations_url":"https://api.github.com/users/gaush123/orgs","repos_url":"https://api.github.com/users/gaush123/repos","events_url":"https://api.github.com/users/gaush123/events{/privacy}","received_events_url":"https://api.github.com/users/gaush123/received_events","type":"User","site_admin":false},"created_at":"2016-03-22T13:34:21Z","updated_at":"2016-03-22T13:34:21Z","body":"@forresti One more question that I do have is, why there is no kernel size mention in the \"pool 10\" layer, the layers which is directly connected to the softmax layer at the top most."}}