{"action":"created","issue":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31577","repository_url":"https://api.github.com/repos/cockroachdb/cockroach","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31577/labels{/name}","comments_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31577/comments","events_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31577/events","html_url":"https://github.com/cockroachdb/cockroach/issues/31577","id":371372544,"node_id":"MDU6SXNzdWUzNzEzNzI1NDQ=","number":31577,"title":"roachtest: kv0/encrypt=true/nodes=3 failed","user":{"login":"cockroach-teamcity","id":20559710,"node_id":"MDQ6VXNlcjIwNTU5NzEw","avatar_url":"https://avatars0.githubusercontent.com/u/20559710?v=4","gravatar_id":"","url":"https://api.github.com/users/cockroach-teamcity","html_url":"https://github.com/cockroach-teamcity","followers_url":"https://api.github.com/users/cockroach-teamcity/followers","following_url":"https://api.github.com/users/cockroach-teamcity/following{/other_user}","gists_url":"https://api.github.com/users/cockroach-teamcity/gists{/gist_id}","starred_url":"https://api.github.com/users/cockroach-teamcity/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cockroach-teamcity/subscriptions","organizations_url":"https://api.github.com/users/cockroach-teamcity/orgs","repos_url":"https://api.github.com/users/cockroach-teamcity/repos","events_url":"https://api.github.com/users/cockroach-teamcity/events{/privacy}","received_events_url":"https://api.github.com/users/cockroach-teamcity/received_events","type":"User","site_admin":false},"labels":[{"id":191587409,"node_id":"MDU6TGFiZWwxOTE1ODc0MDk=","url":"https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure","name":"C-test-failure","color":"c5def5","default":false},{"id":335217860,"node_id":"MDU6TGFiZWwzMzUyMTc4NjA=","url":"https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot","name":"O-robot","color":"666ad1","default":false}],"state":"open","locked":false,"assignee":{"login":"petermattis","id":6201335,"node_id":"MDQ6VXNlcjYyMDEzMzU=","avatar_url":"https://avatars0.githubusercontent.com/u/6201335?v=4","gravatar_id":"","url":"https://api.github.com/users/petermattis","html_url":"https://github.com/petermattis","followers_url":"https://api.github.com/users/petermattis/followers","following_url":"https://api.github.com/users/petermattis/following{/other_user}","gists_url":"https://api.github.com/users/petermattis/gists{/gist_id}","starred_url":"https://api.github.com/users/petermattis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/petermattis/subscriptions","organizations_url":"https://api.github.com/users/petermattis/orgs","repos_url":"https://api.github.com/users/petermattis/repos","events_url":"https://api.github.com/users/petermattis/events{/privacy}","received_events_url":"https://api.github.com/users/petermattis/received_events","type":"User","site_admin":false},"assignees":[{"login":"petermattis","id":6201335,"node_id":"MDQ6VXNlcjYyMDEzMzU=","avatar_url":"https://avatars0.githubusercontent.com/u/6201335?v=4","gravatar_id":"","url":"https://api.github.com/users/petermattis","html_url":"https://github.com/petermattis","followers_url":"https://api.github.com/users/petermattis/followers","following_url":"https://api.github.com/users/petermattis/following{/other_user}","gists_url":"https://api.github.com/users/petermattis/gists{/gist_id}","starred_url":"https://api.github.com/users/petermattis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/petermattis/subscriptions","organizations_url":"https://api.github.com/users/petermattis/orgs","repos_url":"https://api.github.com/users/petermattis/repos","events_url":"https://api.github.com/users/petermattis/events{/privacy}","received_events_url":"https://api.github.com/users/petermattis/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/cockroachdb/cockroach/milestones/17","html_url":"https://github.com/cockroachdb/cockroach/milestone/17","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/milestones/17/labels","id":3492386,"node_id":"MDk6TWlsZXN0b25lMzQ5MjM4Ng==","number":17,"title":"2.2","description":"","creator":{"login":"petermattis","id":6201335,"node_id":"MDQ6VXNlcjYyMDEzMzU=","avatar_url":"https://avatars0.githubusercontent.com/u/6201335?v=4","gravatar_id":"","url":"https://api.github.com/users/petermattis","html_url":"https://github.com/petermattis","followers_url":"https://api.github.com/users/petermattis/followers","following_url":"https://api.github.com/users/petermattis/following{/other_user}","gists_url":"https://api.github.com/users/petermattis/gists{/gist_id}","starred_url":"https://api.github.com/users/petermattis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/petermattis/subscriptions","organizations_url":"https://api.github.com/users/petermattis/orgs","repos_url":"https://api.github.com/users/petermattis/repos","events_url":"https://api.github.com/users/petermattis/events{/privacy}","received_events_url":"https://api.github.com/users/petermattis/received_events","type":"User","site_admin":false},"open_issues":152,"closed_issues":443,"state":"open","created_at":"2018-07-12T18:50:47Z","updated_at":"2018-10-18T14:50:52Z","due_on":null,"closed_at":null},"comments":2,"created_at":"2018-10-18T05:58:35Z","updated_at":"2018-10-18T14:58:09Z","closed_at":null,"author_association":"MEMBER","body":"SHA: https://github.com/cockroachdb/cockroach/commits/310a04983cda8ab8d67cd401814341b9b7f8ce79\n\nParameters:\n\nTo repro, try:\n\n```\n# Don't forget to check out a clean suitable branch and experiment with the\n# stress invocation until the desired results present themselves. For example,\n# using stressrace instead of stress and passing the '-p' stressflag which\n# controls concurrency.\n./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh\ncd ~/go/src/github.com/cockroachdb/cockroach && \\\nmake stress TESTS=kv0/encrypt=true/nodes=3 PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'\n```\n\nFailed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=972825&tab=buildLog\n\n```\nThe test failed on master:\n\ttest.go:606,cluster.go:1098,kv.go:47,cluster.go:1420,errgroup.go:58: /home/agent/work/.go/bin/roachprod run teamcity-972825-kv0-encrypt-true-nodes-3:4 -- ./workload run kv --init --read-percent=0 --splits=1000 --histograms=logs/stats.json --concurrency=192 --duration=10m {pgurl:1-3} returned:\n\t\tstderr:\n\t\t\n\t\tstdout:\n\t\t: signal: killed\n\ttest.go:606,cluster.go:1441,kv.go:50,kv.go:71: unexpected node event: 3: dead\n\n```"},"comment":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/comments/431042337","html_url":"https://github.com/cockroachdb/cockroach/issues/31577#issuecomment-431042337","issue_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31577","id":431042337,"node_id":"MDEyOklzc3VlQ29tbWVudDQzMTA0MjMzNw==","user":{"login":"mberhault","id":5901480,"node_id":"MDQ6VXNlcjU5MDE0ODA=","avatar_url":"https://avatars3.githubusercontent.com/u/5901480?v=4","gravatar_id":"","url":"https://api.github.com/users/mberhault","html_url":"https://github.com/mberhault","followers_url":"https://api.github.com/users/mberhault/followers","following_url":"https://api.github.com/users/mberhault/following{/other_user}","gists_url":"https://api.github.com/users/mberhault/gists{/gist_id}","starred_url":"https://api.github.com/users/mberhault/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mberhault/subscriptions","organizations_url":"https://api.github.com/users/mberhault/orgs","repos_url":"https://api.github.com/users/mberhault/repos","events_url":"https://api.github.com/users/mberhault/events{/privacy}","received_events_url":"https://api.github.com/users/mberhault/received_events","type":"User","site_admin":false},"created_at":"2018-10-18T14:58:09Z","updated_at":"2018-10-18T14:58:09Z","author_association":"CONTRIBUTOR","body":"AWS recommends pointing chrony at their true time service: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/set-time.html\r\n\r\nIn short, it consists of:\r\n```\r\n$ sudo apt install chrony\r\n```\r\n\r\nset the following in `/etc/chrony.conf`:\r\n```\r\nserver 169.254.169.123 prefer iburst\r\n```\r\n\r\n```\r\n$ sudo /etc/init.d/chrony restart\r\n```"}}
{"actor":{"display_login":"mberhault"}}