{"action":"closed","issue":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31296","repository_url":"https://api.github.com/repos/cockroachdb/cockroach","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31296/labels{/name}","comments_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31296/comments","events_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/31296/events","html_url":"https://github.com/cockroachdb/cockroach/issues/31296","id":369423571,"node_id":"MDU6SXNzdWUzNjk0MjM1NzE=","number":31296,"title":"sql: TestSchemaChangePurgeFailure failed under stress","user":{"login":"cockroach-teamcity","id":20559710,"node_id":"MDQ6VXNlcjIwNTU5NzEw","avatar_url":"https://avatars0.githubusercontent.com/u/20559710?v=4","gravatar_id":"","url":"https://api.github.com/users/cockroach-teamcity","html_url":"https://github.com/cockroach-teamcity","followers_url":"https://api.github.com/users/cockroach-teamcity/followers","following_url":"https://api.github.com/users/cockroach-teamcity/following{/other_user}","gists_url":"https://api.github.com/users/cockroach-teamcity/gists{/gist_id}","starred_url":"https://api.github.com/users/cockroach-teamcity/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cockroach-teamcity/subscriptions","organizations_url":"https://api.github.com/users/cockroach-teamcity/orgs","repos_url":"https://api.github.com/users/cockroach-teamcity/repos","events_url":"https://api.github.com/users/cockroach-teamcity/events{/privacy}","received_events_url":"https://api.github.com/users/cockroach-teamcity/received_events","type":"User","site_admin":false},"labels":[{"id":191587409,"node_id":"MDU6TGFiZWwxOTE1ODc0MDk=","url":"https://api.github.com/repos/cockroachdb/cockroach/labels/C-test-failure","name":"C-test-failure","color":"c5def5","default":false},{"id":335217860,"node_id":"MDU6TGFiZWwzMzUyMTc4NjA=","url":"https://api.github.com/repos/cockroachdb/cockroach/labels/O-robot","name":"O-robot","color":"666ad1","default":false}],"state":"closed","locked":false,"assignee":{"login":"eriktrinh","id":15272902,"node_id":"MDQ6VXNlcjE1MjcyOTAy","avatar_url":"https://avatars3.githubusercontent.com/u/15272902?v=4","gravatar_id":"","url":"https://api.github.com/users/eriktrinh","html_url":"https://github.com/eriktrinh","followers_url":"https://api.github.com/users/eriktrinh/followers","following_url":"https://api.github.com/users/eriktrinh/following{/other_user}","gists_url":"https://api.github.com/users/eriktrinh/gists{/gist_id}","starred_url":"https://api.github.com/users/eriktrinh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/eriktrinh/subscriptions","organizations_url":"https://api.github.com/users/eriktrinh/orgs","repos_url":"https://api.github.com/users/eriktrinh/repos","events_url":"https://api.github.com/users/eriktrinh/events{/privacy}","received_events_url":"https://api.github.com/users/eriktrinh/received_events","type":"User","site_admin":false},"assignees":[{"login":"eriktrinh","id":15272902,"node_id":"MDQ6VXNlcjE1MjcyOTAy","avatar_url":"https://avatars3.githubusercontent.com/u/15272902?v=4","gravatar_id":"","url":"https://api.github.com/users/eriktrinh","html_url":"https://github.com/eriktrinh","followers_url":"https://api.github.com/users/eriktrinh/followers","following_url":"https://api.github.com/users/eriktrinh/following{/other_user}","gists_url":"https://api.github.com/users/eriktrinh/gists{/gist_id}","starred_url":"https://api.github.com/users/eriktrinh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/eriktrinh/subscriptions","organizations_url":"https://api.github.com/users/eriktrinh/orgs","repos_url":"https://api.github.com/users/eriktrinh/repos","events_url":"https://api.github.com/users/eriktrinh/events{/privacy}","received_events_url":"https://api.github.com/users/eriktrinh/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/cockroachdb/cockroach/milestones/17","html_url":"https://github.com/cockroachdb/cockroach/milestone/17","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/milestones/17/labels","id":3492386,"node_id":"MDk6TWlsZXN0b25lMzQ5MjM4Ng==","number":17,"title":"2.2","description":"","creator":{"login":"petermattis","id":6201335,"node_id":"MDQ6VXNlcjYyMDEzMzU=","avatar_url":"https://avatars0.githubusercontent.com/u/6201335?v=4","gravatar_id":"","url":"https://api.github.com/users/petermattis","html_url":"https://github.com/petermattis","followers_url":"https://api.github.com/users/petermattis/followers","following_url":"https://api.github.com/users/petermattis/following{/other_user}","gists_url":"https://api.github.com/users/petermattis/gists{/gist_id}","starred_url":"https://api.github.com/users/petermattis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/petermattis/subscriptions","organizations_url":"https://api.github.com/users/petermattis/orgs","repos_url":"https://api.github.com/users/petermattis/repos","events_url":"https://api.github.com/users/petermattis/events{/privacy}","received_events_url":"https://api.github.com/users/petermattis/received_events","type":"User","site_admin":false},"open_issues":138,"closed_issues":352,"state":"open","created_at":"2018-07-12T18:50:47Z","updated_at":"2018-10-15T18:21:15Z","due_on":null,"closed_at":null},"comments":3,"created_at":"2018-10-12T07:00:03Z","updated_at":"2018-10-15T18:21:15Z","closed_at":"2018-10-15T18:21:15Z","author_association":"MEMBER","body":"SHA: https://github.com/cockroachdb/cockroach/commits/62c976dafc7f48f0a52142310a8fdc42908c30a5\n\nParameters:\n```\nTAGS=\nGOFLAGS=-race\n```\n\nTo repro, try:\n\n```\n# Don't forget to check out a clean suitable branch and experiment with the\n# stress invocation until the desired results present themselves. For example,\n# using stressrace instead of stress and passing the '-p' stressflag which\n# controls concurrency.\n./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh\ncd ~/go/src/github.com/cockroachdb/cockroach && \\\nmake stress TESTS=TestSchemaChangePurgeFailure PKG=github.com/cockroachdb/cockroach/pkg/sql TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'\n```\n\nFailed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=961469&tab=buildLog\n\n```\nI181012 06:51:34.845802 107179 sql/event_log.go:126  [n1,client=127.0.0.1:41898,user=root] Event: \"create_table\", target: 53, info: {TableName:t.public.test Statement:CREATE TABLE t.public.test (k INT PRIMARY KEY, v INT) User:root}\nI181012 06:51:34.860952 107197 storage/replica_command.go:298  [n1,split,s1,r20/1:/{Table/23-Max}] initiating a split of this range at key /Table/53 [r21]\nI181012 06:51:35.148326 107179 sql/lease.go:345  [n1,client=127.0.0.1:41898,user=root] publish: descID=53 (test) version=2 mtime=2018-10-12 06:51:35.093760965 +0000 UTC\nI181012 06:51:35.243334 107179 sql/event_log.go:126  [n1,client=127.0.0.1:41898,user=root] Event: \"create_index\", target: 53, info: {TableName:t.public.test IndexName:foo Statement:CREATE UNIQUE INDEX foo ON t.public.test (v) User:root MutationID:1}\nI181012 06:51:35.312095 107267 sql/lease.go:877  new lease: 53(\"test\") ver=2:1539327465.110907697,0, refcount=0\nI181012 06:51:35.485167 106949 sql/lease.go:345  [n1,scExec] publish: descID=53 (test) version=3 mtime=2018-10-12 06:51:35.483388781 +0000 UTC\nI181012 06:51:35.551745 106949 sql/lease.go:315  publish (1 leases): desc=[{test 53 2}]\nI181012 06:51:35.555253 107165 sql/lease.go:877  new lease: 53(\"test\") ver=3:1539327407.976041060,0, refcount=0\nI181012 06:51:35.609356 106949 sql/lease.go:315  publish (1 leases): desc=[{test 53 2}]\nI181012 06:51:35.712915 106949 sql/backfill.go:131  [n1,scExec] Running backfill for \"test\", v=3, m=1\nW181012 06:51:35.828707 106949 sql/schema_changer.go:866  [n1,scExec] reversing schema change 390780338523144193 due to irrecoverable error: duplicate key value (v)=(201) violates unique constraint \"foo\"\nW181012 06:51:35.864763 106949 sql/schema_changer.go:1146  [n1,scExec] reverse schema change mutation: {Descriptor_:0xc421054470 State:DELETE_AND_WRITE_ONLY Direction:ADD MutationID:1 Rollback:false}\nI181012 06:51:35.865114 106949 sql/lease.go:345  [n1,scExec] publish: descID=53 (test) version=4 mtime=2018-10-12 06:51:35.86289029 +0000 UTC\nI181012 06:51:36.070605 106949 sql/event_log.go:126  [n1,scExec] Event: \"reverse_schema_change\", target: 53, info: {Error:duplicate key value (v)=(201) violates unique constraint \"foo\" MutationID:1}\nI181012 06:51:36.117989 107273 sql/lease.go:877  new lease: 53(\"test\") ver=4:1539327393.798664448,0, refcount=0\nI181012 06:51:36.220470 106949 sql/lease.go:345  [n1,scExec] publish: descID=53 (test) version=5 mtime=2018-10-12 06:51:36.215318642 +0000 UTC\nI181012 06:51:36.275277 106949 sql/lease.go:315  publish (1 leases): desc=[{test 53 4}]\nI181012 06:51:36.311751 107229 sql/lease.go:877  new lease: 53(\"test\") ver=5:1539327433.787755650,0, refcount=0\nI181012 06:51:36.344345 106949 sql/lease.go:315  publish (1 leases): desc=[{test 53 4}]\nI181012 06:51:36.428499 106949 sql/backfill.go:131  [n1,scExec] Running backfill for \"test\", v=5, m=1\nI181012 06:51:36.452962 106949 sql/lease.go:345  [n1,scExec] publish: descID=53 (test) version=6 mtime=2018-10-12 06:51:36.451244816 +0000 UTC\nI181012 06:51:36.556242 106949 sql/event_log.go:126  [n1,scExec] Event: \"finish_schema_change_rollback\", target: 53, info: {MutationID:1}\nI181012 06:51:36.597824 106949 sql/lease.go:315  publish (1 leases): desc=[{test 53 5}]\nI181012 06:51:36.610053 107352 sql/lease.go:877  new lease: 53(\"test\") ver=6:1539327339.303763310,0, refcount=0\nI181012 06:51:36.676383 106949 sql/lease.go:315  publish (1 leases): desc=[{test 53 5}]\nW181012 06:51:36.758491 106949 sql/schema_changer.go:1550  [n1] Error executing schema change: duplicate key value (v)=(201) violates unique constraint \"foo\"\nI181012 06:51:36.911190 106409 util/stop/stopper.go:537  quiescing; tasks left:\n1      [async] transport racer\n1      [async] closedts-rangefeed-subscriber\nI181012 06:51:36.916812 106409 util/stop/stopper.go:537  quiescing; tasks left:\n1      [async] transport racer\nI181012 06:51:36.974684 106682 kv/transport_race.go:113  transport race promotion: ran 45 iterations on up to 1395 requests\n--- FAIL: TestSchemaChangePurgeFailure (5.87s)\n\tschema_changer_test.go:1541: <nil>\n\n```"}}
{"actor":{"display_login":"craig"}}