{"action":"closed","issue":{"url":"https://api.github.com/repos/m-lab/etl/issues/465","repository_url":"https://api.github.com/repos/m-lab/etl","labels_url":"https://api.github.com/repos/m-lab/etl/issues/465/labels{/name}","comments_url":"https://api.github.com/repos/m-lab/etl/issues/465/comments","events_url":"https://api.github.com/repos/m-lab/etl/issues/465/events","html_url":"https://github.com/m-lab/etl/issues/465","id":302520342,"number":465,"title":"sidestream data includes malformed IPv6 addresses","user":{"login":"stephen-soltesz","id":1085316,"avatar_url":"https://avatars3.githubusercontent.com/u/1085316?v=4","gravatar_id":"","url":"https://api.github.com/users/stephen-soltesz","html_url":"https://github.com/stephen-soltesz","followers_url":"https://api.github.com/users/stephen-soltesz/followers","following_url":"https://api.github.com/users/stephen-soltesz/following{/other_user}","gists_url":"https://api.github.com/users/stephen-soltesz/gists{/gist_id}","starred_url":"https://api.github.com/users/stephen-soltesz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/stephen-soltesz/subscriptions","organizations_url":"https://api.github.com/users/stephen-soltesz/orgs","repos_url":"https://api.github.com/users/stephen-soltesz/repos","events_url":"https://api.github.com/users/stephen-soltesz/events{/privacy}","received_events_url":"https://api.github.com/users/stephen-soltesz/received_events","type":"User","site_admin":false},"labels":[{"id":608085345,"url":"https://api.github.com/repos/m-lab/etl/labels/P2","name":"P2","color":"e99695","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-03-06T00:44:33Z","updated_at":"2018-03-19T18:26:36Z","closed_at":"2018-03-19T18:26:36Z","author_association":"CONTRIBUTOR","body":"The sidestream parser is reporting errors for IPv6 addresses:\r\n```\r\ntask.go:125: Invalid server IP address: 2001:4c08:2003:3f:::230 with error: IP not parsable. \r\ntask.go:125: Invalid server IP address: 2001:4c08:2003:3f:::238 with error: IP not parsable.\r\ntask.go:125: Invalid server IP address: 2001:438:fffd:2d:::160 with error: IP not parsable.\r\ntask.go:125: Invalid server IP address: 2001:438:fffd:2d:::153 with error: IP not parsable.\r\ntask.go:125: Invalid server IP address: 2001:1af8:4900:b070:::212 with error: IP not parsable.\r\n```\r\n\r\nThese prefixes appear to be from the local server address. https://github.com/m-lab/operator/blob/master/plsync/sites.py#L159\r\n\r\nSo that we are including IPv4 & all IPv6 sidestream metrics, the parser should attempt to correct these malformed IPv6 addresses.\r\n\r\nThis bug is likely in the web100 kernel itself  and likely to be present in all historical data with ipv6 addresses."}}
{"actor":{"display_login":"stephen-soltesz"}}