{"action":"created","issue":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/1491","repository_url":"https://api.github.com/repos/gcp/leela-zero","labels_url":"https://api.github.com/repos/gcp/leela-zero/issues/1491/labels{/name}","comments_url":"https://api.github.com/repos/gcp/leela-zero/issues/1491/comments","events_url":"https://api.github.com/repos/gcp/leela-zero/issues/1491/events","html_url":"https://github.com/gcp/leela-zero/issues/1491","id":327483392,"node_id":"MDU6SXNzdWUzMjc0ODMzOTI=","number":1491,"title":"Separate black and white networks for handicap games","user":{"login":"Ttl","id":544240,"node_id":"MDQ6VXNlcjU0NDI0MA==","avatar_url":"https://avatars2.githubusercontent.com/u/544240?v=4","gravatar_id":"","url":"https://api.github.com/users/Ttl","html_url":"https://github.com/Ttl","followers_url":"https://api.github.com/users/Ttl/followers","following_url":"https://api.github.com/users/Ttl/following{/other_user}","gists_url":"https://api.github.com/users/Ttl/gists{/gist_id}","starred_url":"https://api.github.com/users/Ttl/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Ttl/subscriptions","organizations_url":"https://api.github.com/users/Ttl/orgs","repos_url":"https://api.github.com/users/Ttl/repos","events_url":"https://api.github.com/users/Ttl/events{/privacy}","received_events_url":"https://api.github.com/users/Ttl/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":12,"created_at":"2018-05-29T20:52:52Z","updated_at":"2018-05-31T11:30:46Z","closed_at":null,"author_association":"COLLABORATOR","body":"I made changes to LZ to support separate networks for black and white with a goal to improve handicap performance. The idea is to make the black network strength to match the players strength that is taking the handicap to allow search to take advantage of moves that the weaker network doesn't see. For example when playing against humans it would be natural to use a network trained from human games for black and the strongest self play network for white.\r\n\r\nBased on few positions it seems to work. For example in the latest match against Haylee (https://online-go.com/game/13035133) on move 70 LZ played obviously bad move L2. Running the same position on my computer using the same network and 50k visits gives following visit distribution using single network:\r\n\r\n<details>\r\n<Summary>Single network</Summary>\r\n\r\n```\r\n  G2 ->    9783 (V:  5.88%) (N:  0.15%) PV: G2 H11 A15 D13 B12 B11 C12 C13 B13 D12 B19 A19 G19 C11 D19 D15 C15 A12 B19\r\n A15 ->    7002 (V:  5.26%) (N: 22.35%) PV: A15 D13 C12 C11 B12 C13 B13 D12 A19 B11 B19 A18 B19 A12 C15 D15 A14 A11\r\n  L2 ->    6320 (V:  5.75%) (N:  0.16%) PV: L2 H11 G19 A15 D19 B19 C3 C4 D3 E4 B4 B5 B3 B6 F3\r\n H11 ->    5199 (V:  5.26%) (N: 16.75%) PV: H11 F10 A15 D13 B12 B11 C12 C13 B13 D12 B19 A19 C15 C11 G19 A12 D19 D15 B19\r\n B12 ->    2643 (V:  5.55%) (N:  2.13%) PV: B12 C12 A15 C13 B13 B11 B19 A19 G19 D13 D19 D15 C15 A12 B19\r\n  K2 ->    2119 (V:  5.93%) (N:  0.16%) PV: K2 H11 C12 C11 A15 D13 B12 C13 B13 D12 C15 B11 B19 A19 G19 A12 D19\r\n  M2 ->    1613 (V:  5.70%) (N:  0.17%) PV: M2 H11 A15 D13 B12 B11 C12 C13 B13 D12 B19 A19 C15 C11 G19 A12 D19\r\n C12 ->    1370 (V:  5.48%) (N:  1.92%) PV: C12 C11 A15 D13 B12 C13 B13 D12 A19 B11 B19 A18 B19 A12\r\n G19 ->    1127 (V:  5.61%) (N:  0.30%) PV: G19 H11 A15 C13 B13 B12 C12 C11 D13 D12 D19 B19 C15 C13 A14\r\n  H2 ->     607 (V:  5.71%) (N:  0.16%) PV: H2 H11 A15 D13 B12 B11 C12 C13 B13 D12 B19 A19 C15 C11\r\n  F2 ->     477 (V:  5.92%) (N:  0.15%) PV: F2 C3 H11 C10 F11 R15 F10 E10 D12 D13 C12 E12\r\n E10 ->     410 (V:  4.21%) (N:  4.23%) PV: E10 F10 C10 C11 D11 A9 D10 D12 H11 E11 C3 D3 C4 C2 B2 D2 B1 B5 C5 B6\r\n  H4 ->     337 (V:  5.58%) (N:  0.18%) PV: H4 H11 A15 C13 B13 B12 C12 C11 D13 D12 A12\r\n A19 ->     313 (V:  5.15%) (N:  1.24%) PV: A19 B19 A15 C13 B13 B12 C12 C11 D13 D12 H11 F11\r\n B19 ->     266 (V:  4.29%) (N:  2.62%) PV: B19 A19 A15 D13 B12 B11 C12 C13 B13 D12 H11 E10 C15 C11\r\n  G3 ->     254 (V:  5.56%) (N:  0.17%) PV: G3 H11 A15 C13 B13 B12 C12 C11 D13 D12 A12\r\n  J5 ->     221 (V:  5.54%) (N:  0.18%) PV: J5 H11 A15 C13 B13 B12 C12 C11 D13 D12 A12 B11\r\n  J3 ->     214 (V:  5.64%) (N:  0.15%) PV: J3 H11 A15 C13 B13 B12 C12 C11 D13 D12 A12 B11 B19\r\n  A9 ->     209 (V:  5.27%) (N:  0.64%) PV: A9 C10 H11 F11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  S5 ->     207 (V:  5.53%) (N:  0.19%) PV: S5 H11 A15 C13 D13 D12 C12 B12 B13 C11 A12 B11\r\n  L3 ->     188 (V:  5.53%) (N:  0.17%) PV: L3 H11 A15 C13 B13 B12 C12 C11 D13 D12 A12 B11\r\n  L5 ->     183 (V:  5.52%) (N:  0.19%) PV: L5 H11 A15 C13 B13 B12 C12 C11 D13 D12 A12 B11\r\n  O4 ->     179 (V:  4.78%) (N:  1.17%) PV: O4 P3 H11 C10 F11 A9 F10 R15 D12\r\n  H3 ->     170 (V:  5.60%) (N:  0.16%) PV: H3 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  C3 ->     166 (V:  4.83%) (N:  1.04%) PV: C3 C4 D3 E4 H11 F11 B4 B5 B3 C5 F2 R15\r\n  M5 ->     165 (V:  5.50%) (N:  0.18%) PV: M5 H11 A15 C13 B13 B12 C12 C11 D13\r\n  Q2 ->     155 (V:  5.57%) (N:  0.15%) PV: Q2 Q3 A15 C13 H11 C10 F11\r\n  N6 ->     147 (V:  5.47%) (N:  0.22%) PV: N6 H11 A15 C13 D13 D12 C12 B12 B13\r\n  S6 ->     131 (V:  5.43%) (N:  0.23%) PV: S6 H11 A15 D13 B12 C13 B13 B11 B19 A19 C15 C12 A14\r\n  K6 ->     127 (V:  5.46%) (N:  0.19%) PV: K6 H11 A15 D13 B12 C13 B13 B11 B19 A19\r\n D12 ->     123 (V:  5.23%) (N:  0.42%) PV: D12 C10 H11 F11 A15 D13 B12 C13 B13 C12 B11 A11\r\n  F3 ->     100 (V:  5.53%) (N:  0.15%) PV: F3 H11 A15 C13 B13 B12 C12 C11\r\n  J6 ->      99 (V:  5.41%) (N:  0.19%) PV: J6 H11 A15 C13 B13 C12 B19\r\n  E2 ->      96 (V:  5.76%) (N:  0.14%) PV: E2 C3 H11 C10 F11 A9 F10 R15 D12 E12\r\n  F5 ->      92 (V:  5.33%) (N:  0.22%) PV: F5 E5 H11 F11 A15 B13 C12\r\n B11 ->      87 (V:  4.99%) (N:  0.43%) PV: B11 C10 A15 D13 B12 C13 B13 A11 A14 A12\r\n  C4 ->      84 (V:  4.68%) (N:  0.59%) PV: C4 C3 D3 E3 D2 C2 E2 E4 F3 C5 B4 B5 D5\r\n  M3 ->      79 (V:  5.43%) (N:  0.17%) PV: M3 H11 A15 C13 B13 B12 C12\r\n  D2 ->      78 (V:  5.43%) (N:  0.16%) PV: D2 C3 H11 F11 A15 C13 D13 D12\r\n  H6 ->      78 (V:  5.36%) (N:  0.18%) PV: H6 H11 A15 C13 B13 B12 C12 C11 D13\r\n  J2 ->      74 (V:  5.43%) (N:  0.16%) PV: J2 H11 A15 C13 D13 D12 C12 B12 B13 C11\r\n  L4 ->      69 (V:  5.33%) (N:  0.18%) PV: L4 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  E5 ->      69 (V:  4.85%) (N:  0.41%) PV: E5 D5 D6 F5 E4 E3 F4 G4 F3 F2 G3 H3\r\n  P9 ->      67 (V:  5.27%) (N:  0.19%) PV: P9 H11 E10 F10 C10 C11 D11 A9 D10 D12 E11\r\n  M7 ->      67 (V:  5.27%) (N:  0.20%) PV: M7 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  M6 ->      66 (V:  5.27%) (N:  0.20%) PV: M6 H11 A15 C13 B13 B12 C12 C11\r\n  L6 ->      64 (V:  5.25%) (N:  0.21%) PV: L6 H11 A15 C13 B13 B12 C12 C11 D13\r\n  F6 ->      61 (V:  5.30%) (N:  0.18%) PV: F6 F5 H11 C10 F11 R15 F10 E10\r\n  Q5 ->      58 (V:  4.27%) (N:  0.57%) PV: Q5 R4 P3 O4 Q2 O2 S2 S3\r\n B13 ->      57 (V:  5.28%) (N:  0.18%) PV: B13 A15 H11 C10 F11 A9 F10 R15 D12\r\n  R4 ->      57 (V:  4.58%) (N:  0.45%) PV: R4 R3 Q3 Q5 R2 S3 P3 R5 O4 H11\r\n  J4 ->      56 (V:  5.31%) (N:  0.15%) PV: J4 H11 A15 C13 B13 B12 C12 C11 D13\r\n P11 ->      56 (V:  5.30%) (N:  0.16%) PV: P11 H11 A15 C13 D13 D12 C12 B12\r\n  J7 ->      56 (V:  5.29%) (N:  0.17%) PV: J7 H11 A15 C13 B13 B12 C12 C11 D13\r\n  K4 ->      56 (V:  5.25%) (N:  0.17%) PV: K4 H11 A15 D13 B12 C13 B13 B11 B19 A19 C15\r\n  L7 ->      54 (V:  5.15%) (N:  0.21%) PV: L7 H11 A15 C13 B13 B12 C12 C11\r\n  D3 ->      53 (V:  5.29%) (N:  0.17%) PV: D3 C3 C4 E3 D2 C2 E2 E4 F3\r\n  N7 ->      52 (V:  5.14%) (N:  0.20%) PV: N7 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  N2 ->      49 (V:  5.29%) (N:  0.15%) PV: N2 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  M8 ->      49 (V:  5.13%) (N:  0.20%) PV: M8 H11 E10 F10 C10 C11 D11 A9 D10 D12 B11\r\n  O6 ->      49 (V:  5.13%) (N:  0.20%) PV: O6 H11 A15 C13 B13 B12 C12 C11 D13\r\n  H5 ->      48 (V:  5.24%) (N:  0.16%) PV: H5 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  G4 ->      48 (V:  5.20%) (N:  0.16%) PV: G4 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  Q6 ->      47 (V:  5.22%) (N:  0.17%) PV: Q6 H11 A15 C13 B13 B12 C12 C11\r\n  P7 ->      45 (V:  5.08%) (N:  0.20%) PV: P7 H11 A15 C13 B13 B12 C12\r\n  M9 ->      43 (V:  5.06%) (N:  0.19%) PV: M9 H11 A15 C13 B13 B12 C12 C11\r\n  K5 ->      40 (V:  5.09%) (N:  0.18%) PV: K5 H11 A15 C13 B13 C12 B12 B11\r\n  G6 ->      40 (V:  5.03%) (N:  0.18%) PV: G6 H11 J11 J10 H9 J12 K11 K12 L11\r\n S14 ->      40 (V:  4.52%) (N:  0.34%) PV: S14 H11 A15 C13 D13 D12 C12\r\n  M4 ->      38 (V:  4.96%) (N:  0.19%) PV: M4 H11 A15 C13 B13 B12 C12\r\n  N1 ->      37 (V:  5.12%) (N:  0.16%) PV: N1 H11 A15 D13 B12 B11 C12 C13\r\n  S4 ->      37 (V:  5.00%) (N:  0.17%) PV: S4 H11 A15 C13 B13 B12 C12 C11\r\n  N9 ->      37 (V:  4.99%) (N:  0.19%) PV: N9 H11 E10 F10 C10 C11 D11 A9 D10 D12 B11\r\n  P8 ->      37 (V:  4.98%) (N:  0.19%) PV: P8 H11 A15 C13 B13 B12 C12\r\n  S8 ->      36 (V:  4.95%) (N:  0.17%) PV: S8 H11 A15 D13 B12 B11 C12 C13\r\n  K3 ->      35 (V:  5.06%) (N:  0.16%) PV: K3 H11 A15 C13 B13 B12 C12 C11 D13\r\n  R7 ->      35 (V:  5.02%) (N:  0.17%) PV: R7 H11 A15 C13 B13 B12 C12 C11\r\n O10 ->      35 (V:  4.94%) (N:  0.19%) PV: O10 H11 A15 B13 C12 B12 D12 C11 B19\r\n P10 ->      35 (V:  4.91%) (N:  0.20%) PV: P10 H11 A15 C13 B13 B12 C12 C11\r\n R14 ->      35 (V:  4.45%) (N:  0.30%) PV: R14 H11 A15 C13 B13 B12 C12 C11\r\n  O2 ->      34 (V:  4.99%) (N:  0.16%) PV: O2 P3 H11 C10 F11 R15 F10 A9\r\n  P6 ->      34 (V:  4.68%) (N:  0.23%) PV: P6 Q5 H11 C10 F11 A9 F10 R15\r\n  S7 ->      33 (V:  4.83%) (N:  0.20%) PV: S7 H11 A15 D13 B12 C13 B13 B11\r\n  C2 ->      31 (V:  5.17%) (N:  0.14%) PV: C2 C3 H11 F11 A15 C13 B13\r\n  R3 ->      31 (V:  4.92%) (N:  0.16%) PV: R3 R4 S4 Q3 S2 R2\r\n M10 ->      31 (V:  4.79%) (N:  0.18%) PV: M10 H11 E10 F10 C10 C11 D11 A9 D10 D12\r\n  B3 ->      30 (V:  5.00%) (N:  0.15%) PV: B3 C3 H11 C10 F11 A9 F10\r\n C13 ->      30 (V:  4.98%) (N:  0.16%) PV: C13 A15 H11 F11 E10 F10\r\n  P2 ->      30 (V:  4.95%) (N:  0.16%) PV: P2 P3 H11 C10 F11 A9 F10 R15\r\n  L9 ->      30 (V:  4.92%) (N:  0.17%) PV: L9 H11 J11 J10 H9 K10\r\n  L8 ->      30 (V:  4.76%) (N:  0.21%) PV: L8 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  O1 ->      29 (V:  4.92%) (N:  0.16%) PV: O1 H11 A15 C13 B13 B12 C12 C11 D13\r\n  Q7 ->      29 (V:  4.67%) (N:  0.21%) PV: Q7 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n J11 ->      28 (V:  5.14%) (N:  0.14%) PV: J11 H12 A15 C13 B13 B12 C12\r\n  N5 ->      28 (V:  4.78%) (N:  0.17%) PV: N5 H11 A15 C13 B13 B12 C12 C11\r\n  O9 ->      28 (V:  4.62%) (N:  0.20%) PV: O9 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n R10 ->      28 (V:  4.37%) (N:  0.25%) PV: R10 H11 J11 J10 H9 K10 H12 F11 E10 F10\r\n  M1 ->      27 (V:  5.14%) (N:  0.14%) PV: M1 H11 A15 C13 B13 B12 C12 C11\r\n  N8 ->      26 (V:  4.60%) (N:  0.21%) PV: N8 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n E12 ->      26 (V:  4.40%) (N:  0.23%) PV: E12 F11 E10 F10 C10 C11 D11 A9\r\n S10 ->      25 (V:  4.84%) (N:  0.16%) PV: S10 H11 A15 C13 B13 B12 C12 C11 D13 D12\r\n  S9 ->      25 (V:  4.82%) (N:  0.16%) PV: S9 H11 A15 C13 B13 B12 C12\r\n P12 ->      24 (V:  4.75%) (N:  0.15%) PV: P12 H11 Q11 R11 R10 R12 Q10\r\n D13 ->      24 (V:  4.69%) (N:  0.16%) PV: D13 D12 C12 C11 B12 A15\r\n  Q9 ->      24 (V:  4.62%) (N:  0.17%) PV: Q9 H11 A15 C13 B13 B12 C12\r\n  Q8 ->      24 (V:  4.57%) (N:  0.19%) PV: Q8 H11 A15 C13 B13 B12 C12 C11\r\n  D5 ->      24 (V:  4.28%) (N:  0.25%) PV: D5 E5 C4 C3 D3 E4 C2 B3 B2\r\n  Q3 ->      24 (V:  3.84%) (N:  0.30%) PV: Q3 R3 R4 Q5 R2 S3 P3\r\n F10 ->      24 (V:  3.75%) (N:  0.32%) PV: F10 E10 H11 F11 A15 C13 B13 B12 C12 C11\r\n  F4 ->      23 (V:  4.72%) (N:  0.16%) PV: F4 H11 D5 E5 E4 C4\r\n  T7 ->      23 (V:  4.63%) (N:  0.17%) PV: T7 H11 A15 C13 B13 B12 C12 C11 D13\r\n N10 ->      23 (V:  4.51%) (N:  0.19%) PV: N10 H11 A15 C13 B13 B12 C12 C11\r\n Q11 ->      22 (V:  4.67%) (N:  0.16%) PV: Q11 H11 P12 R11 R10 R12 Q10\r\n  K8 ->      22 (V:  4.66%) (N:  0.17%) PV: K8 H11 A15 C13 B13 B12 C12 C11\r\n  B6 ->      21 (V:  4.89%) (N:  0.15%) PV: B6 H11 C3 D3 C2 C4\r\n L10 ->      21 (V:  4.54%) (N:  0.16%) PV: L10 H11 A15 C13 B13 B12 C12 C11 D13\r\n  K7 ->      21 (V:  4.42%) (N:  0.19%) PV: K7 H11 J11 J10 H9 K10 H12 F11\r\n  P3 ->      21 (V:  4.16%) (N:  0.23%) PV: P3 O4 Q3 R3 R2 R4\r\n C11 ->      21 (V:  4.13%) (N:  0.23%) PV: C11 C10 H11 H12 G13 F11 A15 C13\r\n  H7 ->      20 (V:  4.59%) (N:  0.16%) PV: H7 H11 A15 C13 B13 B12 C12 C11\r\n N11 ->      20 (V:  4.45%) (N:  0.16%) PV: N11 H11 A15 C13 B13 B12 C12 C11\r\n  O7 ->      20 (V:  4.34%) (N:  0.20%) PV: O7 H11 A15 C13 B13 B12 C12 C11\r\n  J1 ->      19 (V:  4.62%) (N:  0.15%) PV: J1 H11 A15 C13 B13 B12 C12 C11 D13\r\n T10 ->      19 (V:  4.61%) (N:  0.15%) PV: T10 H11 A15 C13 B13 B12 C12\r\n  K9 ->      19 (V:  4.58%) (N:  0.15%) PV: K9 H11 A15 C13 B13 B12 C12\r\n  J8 ->      19 (V:  4.54%) (N:  0.16%) PV: J8 H11 A15 C13 B13 B12 C12 C11\r\n J19 ->      19 (V:  4.52%) (N:  0.15%) PV: J19 H11 A15 C13 B13 B12 C12\r\n  O8 ->      19 (V:  4.29%) (N:  0.20%) PV: O8 H11 A15 C13 B13 B12 C12 C11\r\n  A8 ->      19 (V:  3.80%) (N:  0.22%) PV: A8 C10 A15 C13 B13 B12\r\n L18 ->      18 (V:  4.60%) (N:  0.14%) PV: L18 H11 A15 C13 B13 B12 C12 C11\r\n  L1 ->      18 (V:  4.59%) (N:  0.14%) PV: L1 H11 A15 C13 D13 D12\r\n  G5 ->      18 (V:  4.49%) (N:  0.15%) PV: G5 H11 A15 C13 B13 B12 C12\r\n  T6 ->      18 (V:  4.47%) (N:  0.16%) PV: T6 H11 A15 C13 B13 B12 C12 C11\r\n K18 ->      18 (V:  4.42%) (N:  0.16%) PV: K18 H11 A15 C13 B13 B12 C12 C11 D13\r\n N14 ->      18 (V:  4.36%) (N:  0.16%) PV: N14 H11 A15 C13 B13 B12 C12\r\n  R9 ->      18 (V:  4.00%) (N:  0.20%) PV: R9 H11 A15 C13 B13 B12\r\n C10 ->      18 (V:  2.51%) (N:  0.39%) PV: C10 C11 A9 A8 H11 A10 D3\r\n L13 ->      17 (V:  4.65%) (N:  0.14%) PV: L13 H11 A15 C13 B13 B12 C12 C11\r\n L11 ->      17 (V:  4.62%) (N:  0.14%) PV: L11 H11 A15 C13 B13 B12 C12 C11\r\n  T4 ->      17 (V:  4.61%) (N:  0.15%) PV: T4 H11 A15 C13 B13 B12 C12 C11\r\n L15 ->      17 (V:  4.57%) (N:  0.15%) PV: L15 H11 A15 D13 B12 B11 C12 C13\r\n N13 ->      17 (V:  4.43%) (N:  0.15%) PV: N13 H11 A15 C13 B13 B12 C12 C11\r\n  T5 ->      17 (V:  4.41%) (N:  0.15%) PV: T5 H11 A15 C13 B13 B12 C12\r\n J18 ->      17 (V:  4.39%) (N:  0.15%) PV: J18 H11 A15 B13 C12 B12\r\n  E4 ->      17 (V:  4.33%) (N:  0.15%) PV: E4 D5 D3 C3 C2 E3\r\n  R8 ->      17 (V:  4.14%) (N:  0.19%) PV: R8 H11 A15 C13 B13 B12 C12 C11\r\n H12 ->      17 (V:  3.99%) (N:  0.20%) PV: H12 H11 J11 F11 A15 C13 B13 B12 C12\r\n A14 ->      16 (V:  4.43%) (N:  0.14%) PV: A14 A15 H11 C10 F11 R15 F10 A9\r\n  T8 ->      16 (V:  4.30%) (N:  0.15%) PV: T8 H11 A15 C13 B13 B12 C12\r\n O13 ->      16 (V:  4.25%) (N:  0.17%) PV: O13 H11 A15 C13 B13 B12 C12\r\n M11 ->      16 (V:  4.21%) (N:  0.17%) PV: M11 H11 A15 C13 B13 B12 C12 C11\r\n  T9 ->      15 (V:  4.31%) (N:  0.15%) PV: T9 H11 A15 C13 B13 B12\r\n  H8 ->      15 (V:  4.26%) (N:  0.15%) PV: H8 H11 A15 C13 B13 B12\r\n O12 ->      15 (V:  4.25%) (N:  0.15%) PV: O12 H11 A15 C13 B13 B12\r\n H19 ->      15 (V:  4.13%) (N:  0.15%) PV: H19 H11 A15 C13 B13 B12\r\n O11 ->      15 (V:  4.02%) (N:  0.18%) PV: O11 H11 A15 C13 B13 B12 C12\r\n F11 ->      15 (V:  3.09%) (N:  0.26%) PV: F11 F10 H11 E11 A15 B13 C12 B12\r\n  K1 ->      14 (V:  4.28%) (N:  0.15%) PV: K1 H11 A15 D13 B12 B11\r\n O14 ->      14 (V:  4.24%) (N:  0.15%) PV: O14 H11 A15 B13 C12\r\n K14 ->      14 (V:  4.24%) (N:  0.15%) PV: K14 H11 J11 J10 H9 K10 H12 F11\r\n K11 ->      14 (V:  4.19%) (N:  0.14%) PV: K11 H11 A15 C13 B13 B12\r\n  H1 ->      14 (V:  4.14%) (N:  0.15%) PV: H1 H11 J11 J10 H9 K10 H12 F11\r\n  N3 ->      14 (V:  4.14%) (N:  0.15%) PV: N3 O4 H11 C10 F11 A9 F10\r\n K19 ->      14 (V:  3.92%) (N:  0.15%) PV: K19 H11 A15 C13 B13 B12\r\n  O5 ->      14 (V:  3.37%) (N:  0.23%) PV: O5 O4 H11 C10 F11\r\n T12 ->      13 (V:  4.23%) (N:  0.14%) PV: T12 H11 A15 C13 B13 B12\r\n L12 ->      13 (V:  4.19%) (N:  0.14%) PV: L12 H11 A15 D13 B12 B11\r\n  G1 ->      13 (V:  4.12%) (N:  0.14%) PV: G1 H11 A15 C13 B13\r\n M13 ->      13 (V:  3.80%) (N:  0.16%) PV: M13 H11 A15 C13 B13 B12\r\n  N4 ->      13 (V:  3.74%) (N:  0.17%) PV: N4 O4 H11 C10 F11 A9 F10 R15\r\n D11 ->      13 (V:  3.00%) (N:  0.25%) PV: D11 C10 H11 F11 A15 D13 B12 C13 B13 B11\r\n  G7 ->      12 (V:  4.22%) (N:  0.14%) PV: G7 H11 J11 J10 H9 K10 H12 F11\r\n L14 ->      12 (V:  4.07%) (N:  0.14%) PV: L14 H11 A15 C13 B13 B12\r\n R11 ->      12 (V:  4.03%) (N:  0.14%) PV: R11 H11 J11 J10 H9 K10\r\n N12 ->      12 (V:  3.70%) (N:  0.17%) PV: N12 H11 A15 B13 C12 B12\r\n C15 ->      12 (V:  3.59%) (N:  0.15%) PV: C15 A15 H11 F11 C3 C4 D3 E4\r\n Q10 ->      12 (V:  3.55%) (N:  0.18%) PV: Q10 H11 J11 J10 H9 K10 H12\r\n A10 ->      12 (V:  3.48%) (N:  0.18%) PV: A10 C10 A15 B13 C12\r\n M14 ->      11 (V:  3.54%) (N:  0.15%) PV: M14 H11 A15 C13 B13 B12 C12\r\n  B7 ->      11 (V:  3.20%) (N:  0.18%) PV: B7 C10 H11 A9 C3 C4\r\n E11 ->      11 (V:  3.10%) (N:  0.21%) PV: E11 C10 H11 F11 A15 B13 C13\r\n  J9 ->       9 (V:  3.17%) (N:  0.14%) PV: J9 H11 J11 J12 K11 R15 H12\r\n  C7 ->       8 (V:  3.14%) (N:  0.15%) PV: C7 C10 H11 A9 C3 C4\r\n8.8 average depth, 21 max depth\r\n35475 non leaf nodes, 1.33 average children\r\n47220 visits, 13628169 nodes, 47219 playouts, 23 n/s\r\n```\r\n</details>\r\n\r\nIt considers lot of obviously bad moves and played a similarly bad move as in the game.\r\n\r\nWith two networks using the 128x6 network trained from human games for black gives the following distribution:\r\n\r\n<details>\r\n<Summary>Two networks</Summary>\r\n\r\n```\r\n H11 ->   22879 (V: 22.27%) (N: 19.23%) PV: H11 E10 F11 F10 A15 D15 C15 D13 B11 C11 B12 C13 B13 A11 A19 A12 B19 C12 D19 A13 B7 A9 C7 C10\r\n B12 ->    2662 (V: 21.99%) (N:  5.19%) PV: B12 C10 A15 C13 B13 A14 A19 C12 B19 B11 A13 D13 C15 A18\r\n A15 ->    2573 (V: 21.74%) (N: 10.59%) PV: A15 D13 B12 C10 A19 C13 B13 B11 B19 A18 B19 A12 C15 C12 A14 D15 D19 A11 C19\r\n B19 ->     789 (V: 21.85%) (N:  2.48%) PV: B19 A19 H11 F11 E10 F10 C10 C11 A9 A8 D11 A10 D10 D12 B11 E11 A15 D15 C15 C13 B13 B12 A12\r\n E10 ->     545 (V: 20.67%) (N:  6.86%) PV: E10 F10 H11 E11 A15 C13 B13 B12 C12 B11 D13 D12 B19 A19 C15 A13 A14 A12 G19\r\n C12 ->     114 (V: 19.30%) (N:  2.64%) PV: C12 C10 H11 H12 G13 F10 A15 J12 B12\r\n  O4 ->      28 (V: 19.11%) (N:  0.64%) PV: O4 P3 H11 F10 N4 Q5 N3 R3\r\n D12 ->      23 (V: 18.94%) (N:  0.61%) PV: D12 C10 H11 F11 A15 B12 D13 C12 A14\r\n B11 ->      23 (V: 16.87%) (N:  0.98%) PV: B11 C10 H11 F11 A15 A19\r\n G19 ->      19 (V: 19.07%) (N:  0.39%) PV: G19 A15 H11 F11 C3 C4 D3 E3 E2 F2\r\n C10 ->      14 (V: 18.44%) (N:  0.36%) PV: C10 C11 A9 A10 H11 H12 G13 F10 J12 H13\r\n  R4 ->      14 (V: 16.48%) (N:  0.59%) PV: R4 R3 Q5 Q3 O4 P6 P3 P2\r\n  A9 ->      13 (V: 16.46%) (N:  0.53%) PV: A9 C10 H11 F10 A15 D15 C15 B13 C13\r\n F11 ->      12 (V: 18.94%) (N:  0.29%) PV: F11 H11 E12 F13 J11 H12 J12 H13 J13\r\n  E5 ->      12 (V: 16.23%) (N:  0.49%) PV: E5 D5 D6 F6 H11 F11 E4 E3\r\n  C3 ->      12 (V: 16.09%) (N:  0.57%) PV: C3 C4 D3 E3 E2 F3 F2\r\n A19 ->      10 (V: 17.72%) (N:  0.34%) PV: A19 A15 H11 F10 B19 D15 C15\r\n A10 ->      10 (V: 16.57%) (N:  0.34%) PV: A10 C10 H11 H12 G13 H13 G14 H14 G15\r\n  Q5 ->      10 (V: 10.90%) (N:  0.77%) PV: Q5 O4 R4 P3 R3 H11\r\n  Q3 ->       8 (V: 13.92%) (N:  0.48%) PV: Q3 P3 R4 O4 Q2\r\n R14 ->       6 (V: 16.65%) (N:  0.29%) PV: R14 Q14 R13 Q13 H11 F10\r\n  C4 ->       4 (V: 13.56%) (N:  0.27%) PV: C4 C3 D3 E4\r\n  P3 ->       4 (V: 10.12%) (N:  0.31%) PV: P3 O4 Q3 R3\r\n12.9 average depth, 35 max depth\r\n24239 non leaf nodes, 1.23 average children\r\n29785 visits, 8478271 nodes, 29784 playouts, 42 n/s\r\n```\r\n</details>\r\n\r\nThese are much more reasonable moves and the winrate variation is also much bigger allowing the search to function better. G2 and L2 moves don't even get a single visit now.\r\n\r\nThe code can be found at: https://github.com/Ttl/leela-zero/tree/aux_net. Multi-net implementation is based on https://github.com/gcp/leela-zero/issues/1129#issuecomment-377700958.\r\n\r\nCurrently two networks are used the whole game. It probably makes sense to include the weaker network only if the winrate is low but I haven't got around to it yet. Testing should still be possible with the current code."},"comment":{"url":"https://api.github.com/repos/gcp/leela-zero/issues/comments/393501068","html_url":"https://github.com/gcp/leela-zero/issues/1491#issuecomment-393501068","issue_url":"https://api.github.com/repos/gcp/leela-zero/issues/1491","id":393501068,"node_id":"MDEyOklzc3VlQ29tbWVudDM5MzUwMTA2OA==","user":{"login":"Ishinoshita","id":37498331,"node_id":"MDQ6VXNlcjM3NDk4MzMx","avatar_url":"https://avatars0.githubusercontent.com/u/37498331?v=4","gravatar_id":"","url":"https://api.github.com/users/Ishinoshita","html_url":"https://github.com/Ishinoshita","followers_url":"https://api.github.com/users/Ishinoshita/followers","following_url":"https://api.github.com/users/Ishinoshita/following{/other_user}","gists_url":"https://api.github.com/users/Ishinoshita/gists{/gist_id}","starred_url":"https://api.github.com/users/Ishinoshita/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Ishinoshita/subscriptions","organizations_url":"https://api.github.com/users/Ishinoshita/orgs","repos_url":"https://api.github.com/users/Ishinoshita/repos","events_url":"https://api.github.com/users/Ishinoshita/events{/privacy}","received_events_url":"https://api.github.com/users/Ishinoshita/received_events","type":"User","site_admin":false},"created_at":"2018-05-31T11:30:46Z","updated_at":"2018-05-31T11:30:46Z","author_association":"NONE","body":"Of course, I do not suggest to change the NN code, just to reshape the value of value head in MCTS to simulate a smoother squaquing function. "}}
{"actor":{"display_login":"Ishinoshita"}}