{"action":"created","issue":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/2044","repository_url":"https://api.github.com/repos/gcp/leela-zero","labels_url":"https://api.github.com/repos/gcp/leela-zero/issues/2044/labels{/name}","comments_url":"https://api.github.com/repos/gcp/leela-zero/issues/2044/comments","events_url":"https://api.github.com/repos/gcp/leela-zero/issues/2044/events","html_url":"https://github.com/gcp/leela-zero/issues/2044","id":384040312,"node_id":"MDU6SXNzdWUzODQwNDAzMTI=","number":2044,"title":"40b networks are overfit?","user":{"login":"wentaol","id":2791250,"node_id":"MDQ6VXNlcjI3OTEyNTA=","avatar_url":"https://avatars0.githubusercontent.com/u/2791250?v=4","gravatar_id":"","url":"https://api.github.com/users/wentaol","html_url":"https://github.com/wentaol","followers_url":"https://api.github.com/users/wentaol/followers","following_url":"https://api.github.com/users/wentaol/following{/other_user}","gists_url":"https://api.github.com/users/wentaol/gists{/gist_id}","starred_url":"https://api.github.com/users/wentaol/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wentaol/subscriptions","organizations_url":"https://api.github.com/users/wentaol/orgs","repos_url":"https://api.github.com/users/wentaol/repos","events_url":"https://api.github.com/users/wentaol/events{/privacy}","received_events_url":"https://api.github.com/users/wentaol/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2018-11-25T02:21:01Z","updated_at":"2018-11-25T14:37:46Z","closed_at":"2018-11-25T14:37:46Z","author_association":"NONE","body":"I have been running some matches between 157 and 190.\r\n\r\nExperiment 1: 100 normal games (i.e. starting from empty board): 4-96\r\n\r\nExperiment 2: 100 games starting from 50 randomly sampled human game positions: 62-38\r\n(Positions were randomly sampled from 9d games from [this ](https://github.com/featurecat/go-dataset) dataset, between 0-150 moves.)\r\n\r\nExperiment 3: Same as experiment 2, but only positions at the 5th move are sampled: 64-36\r\n\r\nExperiment 4: Same as experiment 2, but between 157 and Elfv1: 40-60\r\n\r\nMatches were at visit parity using the settings: -t3 -v1600 --noponder\r\nResults are uploaded [here](https://drive.google.com/drive/folders/1J_HHpC8P5YIYu0F0xyBzXIYKFD-PREkA?usp=sharing) \r\ntwogtp was used to automatically run the matches, it also handled starting positions and color alternating.\r\n\r\nAs expected, 190 won most of the games in experiment 1.\r\nResult of experiments 2 and 3 are surprising, suggesting 190 and possibly other 40b nets are overfit to self play positions."},"comment":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/comments/441445181","html_url":"https://github.com/gcp/leela-zero/issues/2044#issuecomment-441445181","issue_url":"https://api.github.com/repos/gcp/leela-zero/issues/2044","id":441445181,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0MTQ0NTE4MQ==","user":{"login":"wentaol","id":2791250,"node_id":"MDQ6VXNlcjI3OTEyNTA=","avatar_url":"https://avatars0.githubusercontent.com/u/2791250?v=4","gravatar_id":"","url":"https://api.github.com/users/wentaol","html_url":"https://github.com/wentaol","followers_url":"https://api.github.com/users/wentaol/followers","following_url":"https://api.github.com/users/wentaol/following{/other_user}","gists_url":"https://api.github.com/users/wentaol/gists{/gist_id}","starred_url":"https://api.github.com/users/wentaol/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wentaol/subscriptions","organizations_url":"https://api.github.com/users/wentaol/orgs","repos_url":"https://api.github.com/users/wentaol/repos","events_url":"https://api.github.com/users/wentaol/events{/privacy}","received_events_url":"https://api.github.com/users/wentaol/received_events","type":"User","site_admin":false},"created_at":"2018-11-25T14:37:46Z","updated_at":"2018-11-25T14:37:46Z","author_association":"NONE","body":"Looks like the -time argument for twogtp is needed. Have no idea why it didn't affect the matches without opening though..."}}
{"actor":{"display_login":"wentaol"}}