{"action":"created","issue":{"url":"https://api.github.com/repos/melodyguan/enas/issues/10","repository_url":"https://api.github.com/repos/melodyguan/enas","labels_url":"https://api.github.com/repos/melodyguan/enas/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/melodyguan/enas/issues/10/comments","events_url":"https://api.github.com/repos/melodyguan/enas/issues/10/events","html_url":"https://github.com/melodyguan/enas/issues/10","id":311518629,"number":10,"title":"Question about output value","user":{"login":"sweetdream33","id":36881263,"avatar_url":"https://avatars1.githubusercontent.com/u/36881263?v=4","gravatar_id":"","url":"https://api.github.com/users/sweetdream33","html_url":"https://github.com/sweetdream33","followers_url":"https://api.github.com/users/sweetdream33/followers","following_url":"https://api.github.com/users/sweetdream33/following{/other_user}","gists_url":"https://api.github.com/users/sweetdream33/gists{/gist_id}","starred_url":"https://api.github.com/users/sweetdream33/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sweetdream33/subscriptions","organizations_url":"https://api.github.com/users/sweetdream33/orgs","repos_url":"https://api.github.com/users/sweetdream33/repos","events_url":"https://api.github.com/users/sweetdream33/events{/privacy}","received_events_url":"https://api.github.com/users/sweetdream33/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-04-05T08:34:54Z","updated_at":"2018-04-10T12:30:12Z","closed_at":null,"author_association":"NONE","body":"Thank you for providing us with the code. \r\nI'm running the cifar10_macro_search.sh \r\nThe code, data, hyper parameter were taken as is and not modified.\r\ntail of cifar10_macro_search.sh(in the stdout file) looks like :\r\n\r\n> \r\n\r\n-----------------------------------------------------------------------------\r\n[2]\r\n[3 0]\r\n[0 1 0]\r\n[3 1 0 1]\r\n[0 0 0 0 0]\r\n[0 1 0 1 0 1]\r\n[2 1 1 0 1 0 0]\r\n[1 1 0 0 1 0 0 0]\r\n[1 0 0 0 0 1 1 0 0]\r\n[2 0 0 1 0 0 0 0 0 0]\r\n[1 0 0 0 0 1 0 0 1 1 0]\r\n[5 0 1 0 0 0 1 0 0 0 1 0]\r\nval_acc=0.7734\r\n--------------------------------------------------------------------------------\r\n[2]\r\n[1 0]\r\n[1 0 0]\r\n[5 0 0 1]\r\n[0 0 1 0 0]\r\n[2 0 1 0 0 0]\r\n[2 1 1 0 0 0 1]\r\n[3 0 0 0 1 0 1 1]\r\n[3 0 1 0 0 0 1 0 1]\r\n[5 1 0 0 0 0 0 0 0 0]\r\n[0 1 0 1 1 0 0 0 1 0 1]\r\n[1 1 0 0 0 1 1 1 0 1 1 1]\r\nval_acc=0.8672\r\n--------------------------------------------------------------------------------\r\n[4]\r\n[4 0]\r\n[2 0 1]\r\n[0 0 0 1]\r\n[0 0 0 0 0]\r\n[0 0 0 0 1 1]\r\n[0 0 0 0 0 0 0]\r\n[5 1 0 0 0 0 1 0]\r\n[5 1 0 0 0 0 0 0 1]\r\n[5 0 0 1 0 1 1 0 0 0]\r\n[1 1 1 1 0 1 0 0 0 0 0]\r\n[0 0 0 1 1 0 0 0 1 0 0 1]\r\nval_acc=0.7422\r\n--------------------------------------------------------------------------------\r\n[0]\r\n[4 1]\r\n[1 1 0]\r\n[1 0 0 0]\r\n[5 0 1 1 0]\r\n[2 1 0 0 1 0]\r\n[0 0 0 1 1 1 1]\r\n[5 0 1 1 1 0 0 0]\r\n[4 0 0 0 0 0 0 1 0]\r\n[4 0 0 0 1 0 0 0 0 1]\r\n[5 1 0 0 0 1 0 0 1 0 0]\r\n[0 0 0 0 0 0 1 0 0 0 0 0]\r\nval_acc=0.8516\r\n--------------------------------------------------------------------------------\r\nEpoch 310: Eval\r\nEval at 109120\r\nvalid_accuracy: 0.8068\r\nEval at 109120\r\ntest_accuracy: 0.7946\r\n-----------------------------------------------------------------------------------\r\n\r\n> \r\n\r\nNow I think I'm supposed to take the architecture the best validation, which is:\r\n[2]\r\n[1 0]\r\n[1 0 0]\r\n[5 0 0 1]\r\n[0 0 1 0 0]\r\n[2 0 1 0 0 0]\r\n[2 1 1 0 0 0 1]\r\n[3 0 0 0 1 0 1 1]\r\n[3 0 1 0 0 0 1 0 1]\r\n[5 1 0 0 0 0 0 0 0 0]\r\n[0 1 0 1 1 0 0 0 1 0 1]\r\n[1 1 0 0 0 1 1 1 0 1 1 1]\r\nval_acc=0.8672\r\n\r\nIs that right? Is this result the end of the discovered network(optimal one) using macro search?\r\n Validation accuracy of selected architecture is 86.72%. This result is lower than 96.1%. \r\nWhat's the reason? Do I have to modify parameters ( num_epochs, batch_size,...)?\r\n"},"comment":{"url":"https://api.github.com/repos/melodyguan/enas/issues/comments/380081040","html_url":"https://github.com/melodyguan/enas/issues/10#issuecomment-380081040","issue_url":"https://api.github.com/repos/melodyguan/enas/issues/10","id":380081040,"user":{"login":"zeus7777777","id":6452566,"avatar_url":"https://avatars2.githubusercontent.com/u/6452566?v=4","gravatar_id":"","url":"https://api.github.com/users/zeus7777777","html_url":"https://github.com/zeus7777777","followers_url":"https://api.github.com/users/zeus7777777/followers","following_url":"https://api.github.com/users/zeus7777777/following{/other_user}","gists_url":"https://api.github.com/users/zeus7777777/gists{/gist_id}","starred_url":"https://api.github.com/users/zeus7777777/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zeus7777777/subscriptions","organizations_url":"https://api.github.com/users/zeus7777777/orgs","repos_url":"https://api.github.com/users/zeus7777777/repos","events_url":"https://api.github.com/users/zeus7777777/events{/privacy}","received_events_url":"https://api.github.com/users/zeus7777777/received_events","type":"User","site_admin":false},"created_at":"2018-04-10T12:30:12Z","updated_at":"2018-04-10T12:30:12Z","author_association":"NONE","body":"Same issue as @ShenghaiRong \r\n\r\nBesides his modification, I change `--child_num_branches=4` to `--child_num_branches=6` to match training setting in `cifar10_macro_search.sh`.\r\n\r\nBTW, the architecture between `cifar10_macro_search.sh` and `cifar10_macro_final.sh` is different, need to be documented ?\r\n"}}
{"actor":{"display_login":"zeus7777777"}}