{"action":"created","issue":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/27416","repository_url":"https://api.github.com/repos/cockroachdb/cockroach","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/27416/labels{/name}","comments_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/27416/comments","events_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/27416/events","html_url":"https://github.com/cockroachdb/cockroach/issues/27416","id":340415706,"node_id":"MDU6SXNzdWUzNDA0MTU3MDY=","number":27416,"title":"teamcity: failed tests on master: testrace/Example","user":{"login":"cockroach-teamcity","id":20559710,"node_id":"MDQ6VXNlcjIwNTU5NzEw","avatar_url":"https://avatars0.githubusercontent.com/u/20559710?v=4","gravatar_id":"","url":"https://api.github.com/users/cockroach-teamcity","html_url":"https://github.com/cockroach-teamcity","followers_url":"https://api.github.com/users/cockroach-teamcity/followers","following_url":"https://api.github.com/users/cockroach-teamcity/following{/other_user}","gists_url":"https://api.github.com/users/cockroach-teamcity/gists{/gist_id}","starred_url":"https://api.github.com/users/cockroach-teamcity/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cockroach-teamcity/subscriptions","organizations_url":"https://api.github.com/users/cockroach-teamcity/orgs","repos_url":"https://api.github.com/users/cockroach-teamcity/repos","events_url":"https://api.github.com/users/cockroach-teamcity/events{/privacy}","received_events_url":"https://api.github.com/users/cockroach-teamcity/received_events","type":"User","site_admin":false},"labels":[{"id":191587409,"node_id":"MDU6TGFiZWwxOTE1ODc0MDk=","url":"https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure","name":"C-test-failure","color":"c5def5","default":false},{"id":335217860,"node_id":"MDU6TGFiZWwzMzUyMTc4NjA=","url":"https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot","name":"O-robot","color":"666ad1","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/cockroachdb/cockroach/milestones/13","html_url":"https://github.com/cockroachdb/cockroach/milestone/13","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/milestones/13/labels","id":2745639,"node_id":"MDk6TWlsZXN0b25lMjc0NTYzOQ==","number":13,"title":"2.1","description":"","creator":{"login":"knz","id":642886,"node_id":"MDQ6VXNlcjY0Mjg4Ng==","avatar_url":"https://avatars3.githubusercontent.com/u/642886?v=4","gravatar_id":"","url":"https://api.github.com/users/knz","html_url":"https://github.com/knz","followers_url":"https://api.github.com/users/knz/followers","following_url":"https://api.github.com/users/knz/following{/other_user}","gists_url":"https://api.github.com/users/knz/gists{/gist_id}","starred_url":"https://api.github.com/users/knz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/knz/subscriptions","organizations_url":"https://api.github.com/users/knz/orgs","repos_url":"https://api.github.com/users/knz/repos","events_url":"https://api.github.com/users/knz/events{/privacy}","received_events_url":"https://api.github.com/users/knz/received_events","type":"User","site_admin":false},"open_issues":614,"closed_issues":759,"state":"open","created_at":"2017-09-05T15:30:49Z","updated_at":"2018-07-12T06:13:55Z","due_on":null,"closed_at":null},"comments":0,"created_at":"2018-07-11T21:40:15Z","updated_at":"2018-07-12T06:13:55Z","closed_at":"2018-07-12T06:13:55Z","author_association":"MEMBER","body":"The following tests appear to have failed:\n\n[#773474](https://teamcity.cockroachdb.com/viewLog.html?buildId=773474):\n\n\n```\n--- FAIL: testrace/Example (0.000s)\n\n------- Stdout: -------\ngot:\r\nThe newly initialized tracker has a zero closed timestamp:\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 0\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nA first command arrives on range 12 (though the range isn't known yet to the Tracker).\r\nAll commands initially start out on the right. The command has its timestamp forwarded to 0.000000000,2 .\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 1\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nTwo more commands arrive, on r1 and r12.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 3\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe command on r1 finishes evaluating at Lease Applied Index 10 and lets the Tracker know.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 2\r\n      |               @ 10     (r1)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe command on r12 also finishes quickly, at LAI 77.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 1\r\n      |               @ 10     (r1)\r\n      |               @ 77     (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe system closes out a timestamp (registering 1000 as the next timestamp to close out).\r\nNo problem: nothing is tracked on the left side; returns: 0.000000000,1 and map[]\r\nNote how the items on the right have moved to the left, as they are relevant for the\r\nnext call to Close.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nNothing happens for a while until the system tries to close out the next timestamp.\r\nHowever, the very first proposal is still tracked and blocks progress.\r\nThe call returns a no-op in the form 0.000000000,1 map[] .\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nA new command gets tracked on r12 (and is forwarded to 1.000000000,1 (if necessary).\r\nIt terminates quickly, leaving an MLAI entry of 78 behind.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      |               @ 78     (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nFinally! The slow evaluation finishes and the command gets proposed at index 79.\r\nNote that the right now tracks a smaller value of 78. Consumers have to keep the\r\nmaximum they've seen.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             0 # 0\r\n      |            10 @        (r1)\r\n      |               @ 78     (r12)\r\n      |            79 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe next call to Close() is successful and returns: 1.000000000,0 and map[12:79 1:10]\r\n\r\n  closed=1.000000000,0\r\n      |            next=3.000000000,0\r\n      |          left | right\r\n      |             0 # 0\r\n      |            78 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\nwant:\r\nThe newly initialized tracker has a zero closed timestamp:\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 0\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nA first command arrives on range 12 (though the range isn't known yet to the Tracker).\r\nAll commands initially start out on the right. The command has its timestamp forwarded to 0.000000000,2 .\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 1\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nTwo more commands arrive, on r1 and r12.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 3\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe command on r1 finishes evaluating at Lease Applied Index 10 and lets the Tracker know.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 2\r\n      |               @ 10     (r1)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe command on r12 also finishes quickly, at LAI 77.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 1\r\n      |               @ 10     (r1)\r\n      |               @ 77     (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe system closes out a timestamp (registering 1000 as the next timestamp to close out).\r\nNo problem: nothing is tracked on the left side; returns: 0.000000000,1 and map[]\r\nNote how the items on the right have moved to the left, as they are relevant for the\r\nnext call to Close.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nNothing happens for a while until the system tries to close out the next timestamp.\r\nHowever, the very first proposal is still tracked and blocks progress.\r\nThe call returns a no-op in the form 0.000000000,1 map[] .\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nA new command gets tracked on r12 (and is forwarded to 1.000000000,1 (if necessary).\r\nIt terminates quickly, leaving an MLAI entry of 78 behind.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      |               @ 78     (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nFinally! The slow evaluation finishes and the command gets proposed at index 79.\r\nNote that the right now tracks a smaller value of 78. Consumers have to keep the\r\nmaximum they've seen.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             0 # 0\r\n      |            10 @        (r1)\r\n      |               @ 78     (r12)\r\n      |            79 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe next call to Close() is successful and returns: 1.000000000,0 and map[1:10 12:79]\r\n\r\n  closed=1.000000000,0\r\n      |            next=3.000000000,0\r\n      |          left | right\r\n      |             0 # 0\r\n      |            78 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\n--- FAIL: testrace/Example (0.000s)\n\n------- Stdout: -------\ngot:\r\nThe newly initialized tracker has a zero closed timestamp:\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 0\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nA first command arrives on range 12 (though the range isn't known yet to the Tracker).\r\nAll commands initially start out on the right. The command has its timestamp forwarded to 0.000000000,2 .\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 1\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nTwo more commands arrive, on r1 and r12.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 3\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe command on r1 finishes evaluating at Lease Applied Index 10 and lets the Tracker know.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 2\r\n      |               @ 10     (r1)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe command on r12 also finishes quickly, at LAI 77.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 1\r\n      |               @ 10     (r1)\r\n      |               @ 77     (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe system closes out a timestamp (registering 1000 as the next timestamp to close out).\r\nNo problem: nothing is tracked on the left side; returns: 0.000000000,1 and map[]\r\nNote how the items on the right have moved to the left, as they are relevant for the\r\nnext call to Close.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nNothing happens for a while until the system tries to close out the next timestamp.\r\nHowever, the very first proposal is still tracked and blocks progress.\r\nThe call returns a no-op in the form 0.000000000,1 map[] .\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nA new command gets tracked on r12 (and is forwarded to 1.000000000,1 (if necessary).\r\nIt terminates quickly, leaving an MLAI entry of 78 behind.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      |               @ 78     (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nFinally! The slow evaluation finishes and the command gets proposed at index 79.\r\nNote that the right now tracks a smaller value of 78. Consumers have to keep the\r\nmaximum they've seen.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             0 # 0\r\n      |            10 @        (r1)\r\n      |               @ 78     (r12)\r\n      |            79 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe next call to Close() is successful and returns: 1.000000000,0 and map[12:79 1:10]\r\n\r\n  closed=1.000000000,0\r\n      |            next=3.000000000,0\r\n      |          left | right\r\n      |             0 # 0\r\n      |            78 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\nwant:\r\nThe newly initialized tracker has a zero closed timestamp:\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 0\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nA first command arrives on range 12 (though the range isn't known yet to the Tracker).\r\nAll commands initially start out on the right. The command has its timestamp forwarded to 0.000000000,2 .\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 1\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nTwo more commands arrive, on r1 and r12.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 3\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe command on r1 finishes evaluating at Lease Applied Index 10 and lets the Tracker know.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 2\r\n      |               @ 10     (r1)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe command on r12 also finishes quickly, at LAI 77.\r\n\r\n  closed=0.000000000,0\r\n      |            next=0.000000000,1\r\n      |          left | right\r\n      |             0 # 1\r\n      |               @ 10     (r1)\r\n      |               @ 77     (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe system closes out a timestamp (registering 1000 as the next timestamp to close out).\r\nNo problem: nothing is tracked on the left side; returns: 0.000000000,1 and map[]\r\nNote how the items on the right have moved to the left, as they are relevant for the\r\nnext call to Close.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nNothing happens for a while until the system tries to close out the next timestamp.\r\nHowever, the very first proposal is still tracked and blocks progress.\r\nThe call returns a no-op in the form 0.000000000,1 map[] .\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nA new command gets tracked on r12 (and is forwarded to 1.000000000,1 (if necessary).\r\nIt terminates quickly, leaving an MLAI entry of 78 behind.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             1 # 0\r\n      |            10 @        (r1)\r\n      |            77 @        (r12)\r\n      |               @ 78     (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nFinally! The slow evaluation finishes and the command gets proposed at index 79.\r\nNote that the right now tracks a smaller value of 78. Consumers have to keep the\r\nmaximum they've seen.\r\n\r\n  closed=0.000000000,1\r\n      |            next=1.000000000,0\r\n      |          left | right\r\n      |             0 # 0\r\n      |            10 @        (r1)\r\n      |               @ 78     (r12)\r\n      |            79 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\r\n\r\nThe next call to Close() is successful and returns: 1.000000000,0 and map[1:10 12:79]\r\n\r\n  closed=1.000000000,0\r\n      |            next=3.000000000,0\r\n      |          left | right\r\n      |             0 # 0\r\n      |            78 @        (r12)\r\n      v               v\r\n---------------------------------------------------------> time\n\n```\n\nPlease assign, take a look and update the issue accordingly.\n"},"comment":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/comments/404401092","html_url":"https://github.com/cockroachdb/cockroach/issues/27416#issuecomment-404401092","issue_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/27416","id":404401092,"node_id":"MDEyOklzc3VlQ29tbWVudDQwNDQwMTA5Mg==","user":{"login":"tschottdorf","id":5076964,"node_id":"MDQ6VXNlcjUwNzY5NjQ=","avatar_url":"https://avatars1.githubusercontent.com/u/5076964?v=4","gravatar_id":"","url":"https://api.github.com/users/tschottdorf","html_url":"https://github.com/tschottdorf","followers_url":"https://api.github.com/users/tschottdorf/followers","following_url":"https://api.github.com/users/tschottdorf/following{/other_user}","gists_url":"https://api.github.com/users/tschottdorf/gists{/gist_id}","starred_url":"https://api.github.com/users/tschottdorf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tschottdorf/subscriptions","organizations_url":"https://api.github.com/users/tschottdorf/orgs","repos_url":"https://api.github.com/users/tschottdorf/repos","events_url":"https://api.github.com/users/tschottdorf/events{/privacy}","received_events_url":"https://api.github.com/users/tschottdorf/received_events","type":"User","site_admin":false},"created_at":"2018-07-12T06:13:55Z","updated_at":"2018-07-12T06:13:55Z","author_association":"MEMBER","body":"Fixed by #27417."}}
{"actor":{"display_login":"tschottdorf"}}