{"action":"created","issue":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/1499","repository_url":"https://api.github.com/repos/gcp/leela-zero","labels_url":"https://api.github.com/repos/gcp/leela-zero/issues/1499/labels{/name}","comments_url":"https://api.github.com/repos/gcp/leela-zero/issues/1499/comments","events_url":"https://api.github.com/repos/gcp/leela-zero/issues/1499/events","html_url":"https://github.com/gcp/leela-zero/issues/1499","id":328300269,"node_id":"MDU6SXNzdWUzMjgzMDAyNjk=","number":1499,"title":"An experiment about the benefits of ELF","user":{"login":"bjiyxo","id":30645842,"node_id":"MDQ6VXNlcjMwNjQ1ODQy","avatar_url":"https://avatars2.githubusercontent.com/u/30645842?v=4","gravatar_id":"","url":"https://api.github.com/users/bjiyxo","html_url":"https://github.com/bjiyxo","followers_url":"https://api.github.com/users/bjiyxo/followers","following_url":"https://api.github.com/users/bjiyxo/following{/other_user}","gists_url":"https://api.github.com/users/bjiyxo/gists{/gist_id}","starred_url":"https://api.github.com/users/bjiyxo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bjiyxo/subscriptions","organizations_url":"https://api.github.com/users/bjiyxo/orgs","repos_url":"https://api.github.com/users/bjiyxo/repos","events_url":"https://api.github.com/users/bjiyxo/events{/privacy}","received_events_url":"https://api.github.com/users/bjiyxo/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":11,"created_at":"2018-05-31T21:16:44Z","updated_at":"2018-06-04T01:27:38Z","closed_at":null,"author_association":"NONE","body":"I want to confirm the benefits of ELF, so I trained a network from ecab83bb (131), which hadn't trained any ELF self-play, and trained it with the training data 121-130 & ELF selfplay (5/24 version, so it is ~75k games), so the window is ~500k. The batch size is 512, the learning rate is 0.0001, and run 64k steps. I called it ecab-t (t stands for two, haha my English is really poor.) Here is the weight.\r\nhttps://drive.google.com/file/d/1TwyHP0coYNALQGE278bjFUPWMrXy7ZJV/view?usp=sharing\r\n\r\nAnd I tested ecab83bb (131) with ecab-t. Here are the results,\r\n[ecabvsecab-t.zip](https://github.com/gcp/leela-zero/files/2060093/ecabvsecab-t.zip)\r\n**ecab83bb (131) : ecab-t = 91 : 109**, so the one with ELF has 54.5% win rate. Meanwhile, we have progressed over 10 times, but elf's selfplay may not guarantee us to win 55% once.\r\n\r\nNow we can confirm that the benefit from ELF is little comparing to the noise correction, and the recent dramatic growing is because of the noise correction, not ELF."},"comment":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/comments/394211076","html_url":"https://github.com/gcp/leela-zero/issues/1499#issuecomment-394211076","issue_url":"https://api.github.com/repos/gcp/leela-zero/issues/1499","id":394211076,"node_id":"MDEyOklzc3VlQ29tbWVudDM5NDIxMTA3Ng==","user":{"login":"l1t1","id":23301704,"node_id":"MDQ6VXNlcjIzMzAxNzA0","avatar_url":"https://avatars1.githubusercontent.com/u/23301704?v=4","gravatar_id":"","url":"https://api.github.com/users/l1t1","html_url":"https://github.com/l1t1","followers_url":"https://api.github.com/users/l1t1/followers","following_url":"https://api.github.com/users/l1t1/following{/other_user}","gists_url":"https://api.github.com/users/l1t1/gists{/gist_id}","starred_url":"https://api.github.com/users/l1t1/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/l1t1/subscriptions","organizations_url":"https://api.github.com/users/l1t1/orgs","repos_url":"https://api.github.com/users/l1t1/repos","events_url":"https://api.github.com/users/l1t1/events{/privacy}","received_events_url":"https://api.github.com/users/l1t1/received_events","type":"User","site_admin":false},"created_at":"2018-06-04T01:27:38Z","updated_at":"2018-06-04T01:27:38Z","author_association":"NONE","body":"as my result, ecab-t is weaker than 73a1"}}
{"actor":{"display_login":"l1t1"}}