{"action":"opened","issue":{"url":"https://api.github.com/repos/suragnair/alpha-zero-general/issues/74","repository_url":"https://api.github.com/repos/suragnair/alpha-zero-general","labels_url":"https://api.github.com/repos/suragnair/alpha-zero-general/issues/74/labels{/name}","comments_url":"https://api.github.com/repos/suragnair/alpha-zero-general/issues/74/comments","events_url":"https://api.github.com/repos/suragnair/alpha-zero-general/issues/74/events","html_url":"https://github.com/suragnair/alpha-zero-general/issues/74","id":349181367,"node_id":"MDU6SXNzdWUzNDkxODEzNjc=","number":74,"title":"\"best player from previous iterations\" should not exist in AlphaZero implementation?","user":{"login":"justindujardin","id":101493,"node_id":"MDQ6VXNlcjEwMTQ5Mw==","avatar_url":"https://avatars0.githubusercontent.com/u/101493?v=4","gravatar_id":"","url":"https://api.github.com/users/justindujardin","html_url":"https://github.com/justindujardin","followers_url":"https://api.github.com/users/justindujardin/followers","following_url":"https://api.github.com/users/justindujardin/following{/other_user}","gists_url":"https://api.github.com/users/justindujardin/gists{/gist_id}","starred_url":"https://api.github.com/users/justindujardin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/justindujardin/subscriptions","organizations_url":"https://api.github.com/users/justindujardin/orgs","repos_url":"https://api.github.com/users/justindujardin/repos","events_url":"https://api.github.com/users/justindujardin/events{/privacy}","received_events_url":"https://api.github.com/users/justindujardin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-08-09T15:35:13Z","updated_at":"2018-08-09T15:35:13Z","closed_at":null,"author_association":"NONE","body":"Thanks for the really cool project! I was reading over the AlphaZero paper and it seems like they dropped the self-play evaluation and best player selection in favor of continuous updates to the latest model when they moved from AlphaGo Zero to AlphaZero.\r\n\r\n> In AlphaGo Zero, self-play games were generated by the best player from all previous iterations.\r\nAfter each iteration of training, the performance of the new player was measured against\r\nthe best player; if it won by a margin of 55% then it replaced the best player and self-play games\r\nwere subsequently generated by this new player. In contrast, AlphaZero simply maintains a single\r\nneural network that is updated continually, rather than waiting for an iteration to complete. Self-play games are generated by using the latest parameters for this neural network, omitting\r\nthe evaluation step and the selection of best player.\r\n\r\nIt seems like they did not offer a lot of detail about the way they continuously update the model. I'm guessing they used some distributed model with Tensorflow that takes care of coordinating the model updates.\r\n\r\nAre there any plans to update this repo with a continuously updated model like in AlphaZero?"}}
{"actor":{"display_login":"justindujardin"}}