{"action":"closed","issue":{"url":"https://api.github.com/repos/cockroachdb/cockroach/issues/10890","repository_url":"https://api.github.com/repos/cockroachdb/cockroach","labels_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/10890/labels{/name}","comments_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/10890/comments","events_url":"https://api.github.com/repos/cockroachdb/cockroach/issues/10890/events","html_url":"https://github.com/cockroachdb/cockroach/issues/10890","id":190671203,"number":10890,"title":"(unknown): (unknown) failed under stress","user":{"login":"cockroach-teamcity","id":20559710,"avatar_url":"https://avatars.githubusercontent.com/u/20559710?v=3","gravatar_id":"","url":"https://api.github.com/users/cockroach-teamcity","html_url":"https://github.com/cockroach-teamcity","followers_url":"https://api.github.com/users/cockroach-teamcity/followers","following_url":"https://api.github.com/users/cockroach-teamcity/following{/other_user}","gists_url":"https://api.github.com/users/cockroach-teamcity/gists{/gist_id}","starred_url":"https://api.github.com/users/cockroach-teamcity/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cockroach-teamcity/subscriptions","organizations_url":"https://api.github.com/users/cockroach-teamcity/orgs","repos_url":"https://api.github.com/users/cockroach-teamcity/repos","events_url":"https://api.github.com/users/cockroach-teamcity/events{/privacy}","received_events_url":"https://api.github.com/users/cockroach-teamcity/received_events","type":"User","site_admin":false},"labels":[{"id":335217860,"url":"https://api.github.com/repos/cockroachdb/cockroach/labels/Robot","name":"Robot","color":"5319e7","default":false},{"id":191587409,"url":"https://api.github.com/repos/cockroachdb/cockroach/labels/test-failure","name":"test-failure","color":"e11d21","default":false}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2016-11-21T10:11:15Z","updated_at":"2016-11-21T17:25:55Z","closed_at":"2016-11-21T17:25:55Z","body":"SHA: https://github.com/cockroachdb/cockroach/commits/425c005d8b55ab834091079937847a1b552e5364\n\nStress build found a failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=54292\n\n```\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc42424fae0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20563 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*Store).startGossip.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:1245 +0x39b\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc427a7a360)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20667 [select]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).bootstrap.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:998 +0x46c\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc429af46c0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20417 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*Store).Start.func3()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:1149 +0x165\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc428a8e400)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20668 [select]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).manage.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:1027 +0x394\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc429af46d0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20542 [semacquire]:\nsync.runtime_notifyListWait(0xc42016a010, 0xc4000001f4)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42016a000)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc426406aa0, 0xc42e9dd680)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc425e446c0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20535 [select]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).manage.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:1027 +0x394\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc426b103d0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20694 [semacquire]:\nsync.runtime_notifyListWait(0xc42def3090, 0xc40000011f)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42def3080)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc42bf73ea0, 0xc42630bd40)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc425e453c0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20774 [select]:\ngoogle.golang.org/grpc/transport.(*recvBufferReader).Read(0xc42e42fa80, 0xc427366070, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a\ngoogle.golang.org/grpc/transport.(*Stream).Read(0xc424c89c20, 0xc427366070, 0x5, 0x5, 0xc4299e9c20, 0x6d5e20, 0xc426406ab8)\n\t/go/src/google.golang.org/grpc/transport/transport.go:314 +0x59\nio.ReadAtLeast(0x251b040, 0xc424c89c20, 0xc427366070, 0x5, 0x5, 0x5, 0xc4299e9d78, 0x6e7266, 0xc426406aa0)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x251b040, 0xc424c89c20, 0xc427366070, 0x5, 0x5, 0xc4299e9d08, 0x1, 0x0)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngoogle.golang.org/grpc.(*parser).recvMsg(0xc427366060, 0x7fffffff, 0x2, 0x18, 0x1bae031, 0x1bae030, 0xc41fd1f969, 0x0)\n\t/go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f\ngoogle.golang.org/grpc.recv(0xc427366060, 0x252ce40, 0x2a27c00, 0xc424c89c20, 0x0, 0x0, 0x1908a20, 0xc425c0d2a0, 0x7fffffff, 0xc426dec801, ...)\n\t/go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d\ngoogle.golang.org/grpc.(*serverStream).RecvMsg(0xc42e14cbd0, 0x1908a20, 0xc425c0d2a0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/stream.go:492 +0xec\ngithub.com/cockroachdb/cockroach/pkg/storage.(*multiRaftRaftMessageBatchServer).Recv(0xc426dec8c0, 0x7f63327d1130, 0xc425b58720, 0xc42f970470)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft.pb.go:346 +0x62\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).RaftMessageBatch.func1.1.1(0x2534860, 0xc426dec8c0, 0xc425d16f00, 0xc42189c788, 0xc42189c790)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:301 +0x45\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).RaftMessageBatch.func1.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:324 +0x45\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc425b58780)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20745 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*baseQueue).processLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/queue.go:451 +0x357\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc42b4d63a0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20509 [IO wait]:\nnet.runtime_pollWait(0x7f63316272d8, 0x72, 0x0)\n\t/usr/local/go/src/runtime/netpoll.go:160 +0x59\nnet.(*pollDesc).wait(0xc422b10760, 0x72, 0xc4244ab5f0, 0xc420014240)\n\t/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38\nnet.(*pollDesc).waitRead(0xc422b10760, 0x251f040, 0xc420014240)\n\t/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34\nnet.(*netFD).accept(0xc422b10700, 0x0, 0x251bf40, 0xc426f19b80)\n\t/usr/local/go/src/net/fd_unix.go:419 +0x238\nnet.(*TCPListener).accept(0xc421cdd7a0, 0x5ffade, 0xc4244ab6a0, 0xa8e919)\n\t/usr/local/go/src/net/tcpsock_posix.go:132 +0x2e\nnet.(*TCPListener).Accept(0xc421cdd7a0, 0x1bb63b0, 0xc42a6801e0, 0x2535e80, 0xc421cdd7a8)\n\t/usr/local/go/src/net/tcpsock.go:222 +0x49\ngoogle.golang.org/grpc.(*Server).Serve(0xc42a6801e0, 0x252bc40, 0xc421cdd7a0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:348 +0x15a\ngithub.com/cockroachdb/cockroach/pkg/util/netutil.ListenAndServeGRPC.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:56 +0x3c\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc426f19a00)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20693 [semacquire]:\nsync.runtime_notifyListWait(0xc42def3090, 0xc400000118)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42def3080)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc42bf73ea0, 0xc42630bd40)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc425e453a0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20553 [semacquire]:\nsync.runtime_notifyListWait(0xc42016a010, 0xc4000001f0)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42016a000)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc426406aa0, 0xc42e9dd680)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc425e44960)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20477 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/rpc.NewContext.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:137 +0x76\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc42a593860)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20508 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/util/netutil.ListenAndServeGRPC.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:49 +0x6f\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc427e45aa0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20697 [semacquire]:\nsync.runtime_notifyListWait(0xc42def3090, 0xc400000117)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42def3080)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc42bf73ea0, 0xc42630bd40)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc425e45440)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20594 [semacquire]:\nsync.runtime_notifyListWait(0xc42cc74550, 0xc400000216)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42cc74540)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc42a680b40, 0xc42e613a70)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e613a70, 0xc425582a60)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20747 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*baseQueue).processLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/queue.go:451 +0x357\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc42b4d63e0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20568 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*replicaScanner).waitAndProcess(0xc426406d20, 0x7f6332868108, 0xc420014588, 0xecfc4bf38, 0x18fbec37, 0x29eafc0, 0xc420398080, 0xc42e9dd680, 0xc42653ac00, 0xecfc4bf38)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scanner.go:207 +0x254\ngithub.com/cockroachdb/cockroach/pkg/storage.(*replicaScanner).scanLoop.func1.1(0xc42653ac00, 0xc42836b3e0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scanner.go:269 +0x8e\ngithub.com/cockroachdb/cockroach/pkg/storage.(*storeReplicaVisitor).Visit(0xc42836b3e0, 0xc4281faf00)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:306 +0x303\ngithub.com/cockroachdb/cockroach/pkg/storage.(*replicaScanner).scanLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scanner.go:271 +0x2ca\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc428a8e4e0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20772 [select]:\ngoogle.golang.org/grpc.NewClientStream.func2(0x2534bc0, 0xc425850a00, 0xc424c89b30, 0xc421fc9440)\n\t/go/src/google.golang.org/grpc/stream.go:197 +0x426\ncreated by google.golang.org/grpc.NewClientStream\n\t/go/src/google.golang.org/grpc/stream.go:217 +0xb5f\n\ngoroutine 20545 [semacquire]:\nsync.runtime_notifyListWait(0xc42016a010, 0xc4000001f7)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42016a000)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc426406aa0, 0xc42e9dd680)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc425e44760)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20703 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*Store).raftTickLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:3284 +0x334\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc426b11f00)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20632 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*Store).startGossip.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:1245 +0x39b\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc426f1f260)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20658 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*baseQueue).processLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/queue.go:451 +0x357\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e613a70, 0xc426f19f00)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20449 [select]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*server).Gossip(0xc4232fd440, 0x2534440, 0xc426af3fa0, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:190 +0x57b\ngithub.com/cockroachdb/cockroach/pkg/gossip._Gossip_Gossip_Handler(0x1970d80, 0xc4232fd440, 0x2530720, 0xc4268b50e0, 0xc4245ebd40, 0x19c2ed7)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.pb.go:209 +0xbb\ngoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc42c77d4a0, 0xc42a8b6b10, 0x24fdf80, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:689 +0x702\ngoogle.golang.org/grpc.(*Server).handleStream(0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc42c77d4a0, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:773 +0xc36\ngoogle.golang.org/grpc.(*Server).serveStreams.func1.1(0xc426af3a10, 0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc42c77d4a0)\n\t/go/src/google.golang.org/grpc/server.go:422 +0xab\ncreated by google.golang.org/grpc.(*Server).serveStreams.func1\n\t/go/src/google.golang.org/grpc/server.go:423 +0xa3\n\ngoroutine 20746 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*baseQueue).processLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/queue.go:451 +0x357\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc42b4d63c0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20558 [semacquire]:\nsync.runtime_notifyListWait(0xc42def3090, 0xc400000115)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42def3080)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc42bf73ea0, 0xc42630bd40)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc425e451a0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20539 [semacquire]:\nsync.runtime_notifyListWait(0xc42016a010, 0xc4000001f1)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42016a000)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc426406aa0, 0xc42e9dd680)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc425e44660)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20801 [select]:\ngoogle.golang.org/grpc.NewClientStream.func2(0x2534bc0, 0xc4299ccf00, 0xc42814d590, 0xc42a349320)\n\t/go/src/google.golang.org/grpc/stream.go:197 +0x426\ncreated by google.golang.org/grpc.NewClientStream\n\t/go/src/google.golang.org/grpc/stream.go:217 +0xb5f\n\ngoroutine 20536 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*intentResolver).Start.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/intent_resolver.go:80 +0x1ed\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc42a593e40)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20652 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*baseQueue).processLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/queue.go:451 +0x357\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e613a70, 0xc426e14740)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20783 [select]:\ngoogle.golang.org/grpc/transport.(*recvBufferReader).Read(0xc42d417600, 0xc427367f70, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a\ngoogle.golang.org/grpc/transport.(*Stream).Read(0xc42cad8c30, 0xc427367f70, 0x5, 0x5, 0x5cd0ea, 0xc42c95bba0, 0xc42c95bbb0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:314 +0x59\nio.ReadAtLeast(0x251b040, 0xc42cad8c30, 0xc427367f70, 0x5, 0x5, 0x5, 0x183c2e0, 0xc428a60a38, 0xc429224e01)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x251b040, 0xc42cad8c30, 0xc427367f70, 0x5, 0x5, 0x16, 0xc42afc9080, 0xc42c95bc30)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngoogle.golang.org/grpc.(*parser).recvMsg(0xc427367f60, 0x7fffffff, 0xd93b6c, 0x183c2e0, 0xc428a60a38, 0xc42c95bd08, 0x672d1e, 0xc428a60a38)\n\t/go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f\ngoogle.golang.org/grpc.recv(0xc427367f60, 0x252ce40, 0x2a27c00, 0xc42cad8c30, 0x0, 0x0, 0x1908b00, 0xc42ffc41e0, 0x7fffffff, 0xc420536000, ...)\n\t/go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d\ngoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc42e8b66c0, 0x1908b00, 0xc42ffc41e0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/stream.go:305 +0xc4\ngithub.com/cockroachdb/cockroach/pkg/storage.(*multiRaftRaftMessageBatchClient).Recv(0xc428c84b60, 0x7f63327d1130, 0xc42ffc4120, 0xc42ffc4060)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft.pb.go:278 +0x62\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).processQueue.func1.1.1(0x2535d00, 0xc428c84b60, 0xc42d344a40, 0xc429f7ff80, 0x7f6332868108, 0xc420014588, 0xadf36f, 0xc42189c788)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:468 +0x56\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).processQueue.func1.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:485 +0xdd\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc429cfed80)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20639 [select]:\ngoogle.golang.org/grpc.NewClientStream.func2(0x2534bc0, 0xc425850a00, 0xc424c89680, 0xc421fc8d80)\n\t/go/src/google.golang.org/grpc/stream.go:197 +0x426\ncreated by google.golang.org/grpc.NewClientStream\n\t/go/src/google.golang.org/grpc/stream.go:217 +0xb5f\n\ngoroutine 20533 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*server).start.func3()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:381 +0x66\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc42a593e20)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20782 [select]:\ngoogle.golang.org/grpc.NewClientStream.func2(0x2534bc0, 0xc425850a00, 0xc42cad8c30, 0xc42e8b66c0)\n\t/go/src/google.golang.org/grpc/stream.go:197 +0x426\ncreated by google.golang.org/grpc.NewClientStream\n\t/go/src/google.golang.org/grpc/stream.go:217 +0xb5f\n\ngoroutine 20777 [select]:\ngoogle.golang.org/grpc/transport.(*recvBufferReader).Read(0xc42d359ec0, 0xc427367470, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a\ngoogle.golang.org/grpc/transport.(*Stream).Read(0xc42cad84b0, 0xc427367470, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:314 +0x59\nio.ReadAtLeast(0x251b040, 0xc42cad84b0, 0xc427367470, 0x5, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x251b040, 0xc42cad84b0, 0xc427367470, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngoogle.golang.org/grpc.(*parser).recvMsg(0xc427367460, 0x7fffffff, 0x0, 0x18, 0x1bae031, 0x1bae030, 0xc41fc60efd, 0x0)\n\t/go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f\ngoogle.golang.org/grpc.recv(0xc427367460, 0x252ce40, 0x2a27c00, 0xc42cad84b0, 0x0, 0x0, 0x1908a20, 0xc4273e2020, 0x7fffffff, 0xc426c1c701, ...)\n\t/go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d\ngoogle.golang.org/grpc.(*serverStream).RecvMsg(0xc42e14d200, 0x1908a20, 0xc4273e2020, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/stream.go:492 +0xec\ngithub.com/cockroachdb/cockroach/pkg/storage.(*multiRaftRaftMessageBatchServer).Recv(0xc426c1c7d0, 0x7f63327d1130, 0xc42556a9c0, 0xc42fa1b200)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft.pb.go:346 +0x62\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).RaftMessageBatch.func1.1.1(0x2534860, 0xc426c1c7d0, 0xc429f7ff80, 0xc42189c788, 0xc42189c790)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:301 +0x45\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).RaftMessageBatch.func1.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:324 +0x45\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc42556a9f0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20661 [select]:\ngoogle.golang.org/grpc/transport.(*http2Server).controller(0xc42630be60)\n\t/go/src/google.golang.org/grpc/transport/http2_server.go:673 +0x69c\ncreated by google.golang.org/grpc/transport.newHTTP2Server\n\t/go/src/google.golang.org/grpc/transport/http2_server.go:139 +0x767\n\ngoroutine 20619 [IO wait]:\nnet.runtime_pollWait(0x7f6331627818, 0x72, 0x0)\n\t/usr/local/go/src/runtime/netpoll.go:160 +0x59\nnet.(*pollDesc).wait(0xc428e81b10, 0x72, 0xc420650df0, 0xc420014240)\n\t/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38\nnet.(*pollDesc).waitRead(0xc428e81b10, 0x251f040, 0xc420014240)\n\t/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34\nnet.(*netFD).accept(0xc428e81ab0, 0x0, 0x251bf40, 0xc429c8e2a0)\n\t/usr/local/go/src/net/fd_unix.go:419 +0x238\nnet.(*TCPListener).accept(0xc42823c960, 0x5ffade, 0xc420650ea0, 0xa8e919)\n\t/usr/local/go/src/net/tcpsock_posix.go:132 +0x2e\nnet.(*TCPListener).Accept(0xc42823c960, 0x1bb63b0, 0xc42bf73c20, 0x2535e80, 0xc421cdd7d8)\n\t/usr/local/go/src/net/tcpsock.go:222 +0x49\ngoogle.golang.org/grpc.(*Server).Serve(0xc42bf73c20, 0x252bc40, 0xc42823c960, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:348 +0x15a\ngithub.com/cockroachdb/cockroach/pkg/util/netutil.ListenAndServeGRPC.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:56 +0x3c\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc4255834c0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20562 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*Store).startGossip.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:1245 +0x39b\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc427a7a330)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20552 [semacquire]:\nsync.runtime_notifyListWait(0xc42016a010, 0xc4000001f3)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42016a000)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc426406aa0, 0xc42e9dd680)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc425e44860)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20537 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:171 +0x55\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc425e44620)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20623 [semacquire]:\nsync.runtime_Semacquire(0xc420128684)\n\t/usr/local/go/src/runtime/sema.go:47 +0x30\nsync.(*Mutex).Lock(0xc420128680)\n\t/usr/local/go/src/sync/mutex.go:85 +0xd0\ngithub.com/sasha-s/go-deadlock.(*lockOrder).PreLock(0xc420128680, 0x4, 0x183c2e0, 0xc4232fd470)\n\t/go/src/github.com/sasha-s/go-deadlock/deadlock.go:245 +0x87\ngithub.com/sasha-s/go-deadlock.PreLock(0x4, 0x183c2e0, 0xc4232fd470)\n\t/go/src/github.com/sasha-s/go-deadlock/deadlock.go:135 +0x4b\ngithub.com/sasha-s/go-deadlock.lock(0xc4302961b0, 0x183c2e0, 0xc4232fd470)\n\t/go/src/github.com/sasha-s/go-deadlock/deadlock.go:151 +0x93\ngithub.com/sasha-s/go-deadlock.(*Mutex).Lock(0xc4232fd470)\n\t/go/src/github.com/sasha-s/go-deadlock/deadlock.go:55 +0x78\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*server).Gossip(0xc4232fd440, 0x2534440, 0xc428a614d0, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:162 +0x3e2\ngithub.com/cockroachdb/cockroach/pkg/gossip._Gossip_Gossip_Handler(0x1970d80, 0xc4232fd440, 0x2530720, 0xc42c0d1950, 0xc41fb6937d, 0xc4244a9590)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.pb.go:209 +0xbb\ngoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc424f032c0, 0xc42a8b6b10, 0x24fdf80, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:689 +0x702\ngoogle.golang.org/grpc.(*Server).handleStream(0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc424f032c0, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:773 +0xc36\ngoogle.golang.org/grpc.(*Server).serveStreams.func1.1(0xc426af3a10, 0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc424f032c0)\n\t/go/src/google.golang.org/grpc/server.go:422 +0xab\ncreated by google.golang.org/grpc.(*Server).serveStreams.func1\n\t/go/src/google.golang.org/grpc/server.go:423 +0xa3\n\ngoroutine 20481 [IO wait]:\nnet.runtime_pollWait(0x7f6331627518, 0x72, 0x6)\n\t/usr/local/go/src/runtime/netpoll.go:160 +0x59\nnet.(*pollDesc).wait(0xc42cb2d090, 0x72, 0xc4291f1b08, 0xc420014240)\n\t/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38\nnet.(*pollDesc).waitRead(0xc42cb2d090, 0x251f040, 0xc420014240)\n\t/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34\nnet.(*netFD).Read(0xc42cb2d030, 0xc42c004000, 0x8000, 0x8000, 0x0, 0x251f040, 0xc420014240)\n\t/usr/local/go/src/net/fd_unix.go:243 +0x1a1\nnet.(*conn).Read(0xc4242503d8, 0xc42c004000, 0x8000, 0x8000, 0x0, 0x0, 0x0)\n\t/usr/local/go/src/net/net.go:173 +0x70\nbufio.(*Reader).fill(0xc425cef500)\n\t/usr/local/go/src/bufio/bufio.go:97 +0x10c\nbufio.(*Reader).Read(0xc425cef500, 0xc428ea21b8, 0x9, 0x9, 0x6203c0, 0xc4203fad80, 0xc4291f1d08)\n\t/usr/local/go/src/bufio/bufio.go:209 +0x1bc\nio.ReadAtLeast(0x2516200, 0xc425cef500, 0xc428ea21b8, 0x9, 0x9, 0x9, 0xc4269e5988, 0x251b180, 0xc43011f7a0)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x2516200, 0xc425cef500, 0xc428ea21b8, 0x9, 0x9, 0xda0698, 0xc424c88f00, 0xc42fe6cfc0)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngolang.org/x/net/http2.readFrameHeader(0xc428ea21b8, 0x9, 0x9, 0x2516200, 0xc425cef500, 0x0, 0xc400000000, 0x0, 0x219)\n\t/go/src/golang.org/x/net/http2/frame.go:237 +0x7b\ngolang.org/x/net/http2.(*Framer).ReadFrame(0xc428ea2180, 0x25217c0, 0xc43011f770, 0x0, 0x0)\n\t/go/src/golang.org/x/net/http2/frame.go:464 +0xa4\ngoogle.golang.org/grpc/transport.(*framer).readFrame(0xc42a8b6f90, 0xc43011f770, 0xc43011f770, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f\ngoogle.golang.org/grpc/transport.(*http2Client).reader(0xc425850a00)\n\t/go/src/google.golang.org/grpc/transport/http2_client.go:921 +0xb6\ncreated by google.golang.org/grpc/transport.newHTTP2Client\n\t/go/src/google.golang.org/grpc/transport/http2_client.go:203 +0x8b1\n\ngoroutine 20592 [semacquire]:\nsync.runtime_notifyListWait(0xc42cc74550, 0xc40000021e)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42cc74540)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc42a680b40, 0xc42e613a70)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e613a70, 0xc425582a20)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20618 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/util/netutil.ListenAndServeGRPC.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/netutil/net.go:49 +0x6f\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc4269169c0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20819 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).RaftMessageBatch(0xc425d16f00, 0x2534860, 0xc425afe920, 0xc421899ca8, 0x20)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:330 +0x1b0\ngithub.com/cockroachdb/cockroach/pkg/storage._MultiRaft_RaftMessageBatch_Handler(0x198cbc0, 0xc425d16f00, 0x2530720, 0xc42d34e120, 0x7f63329012c0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft.pb.go:327 +0xbb\ngoogle.golang.org/grpc.(*Server).processStreamingRPC(0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc42814dc20, 0xc42a8b6630, 0x25050a0, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:689 +0x702\ngoogle.golang.org/grpc.(*Server).handleStream(0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc42814dc20, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:773 +0xc36\ngoogle.golang.org/grpc.(*Server).serveStreams.func1.1(0xc426af3a10, 0xc42c07a8c0, 0x2534c20, 0xc4268b4900, 0xc42814dc20)\n\t/go/src/google.golang.org/grpc/server.go:422 +0xab\ncreated by google.golang.org/grpc.(*Server).serveStreams.func1\n\t/go/src/google.golang.org/grpc/server.go:423 +0xa3\n\ngoroutine 20750 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*baseQueue).processLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/queue.go:451 +0x357\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc42b4d6a40)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20588 [select]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*Gossip).manage.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.go:1027 +0x394\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc428a60360)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20751 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*replicaScanner).waitAndProcess(0xc428a22d20, 0x7f6332868108, 0xc420014588, 0xecfc4bf38, 0xc4216ac9db, 0x29eafc0, 0xc420398080, 0xc42630bd40, 0x0, 0xc420f06f38)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scanner.go:207 +0x254\ngithub.com/cockroachdb/cockroach/pkg/storage.(*replicaScanner).scanLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scanner.go:274 +0x3ee\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc42b4d6a60)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20603 [semacquire]:\nsync.runtime_notifyListWait(0xc42cc74550, 0xc400000215)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42cc74540)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc42a680b40, 0xc42e613a70)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e613a70, 0xc425582c20)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20626 [select]:\ngoogle.golang.org/grpc.NewClientStream.func2(0x2534bc0, 0xc425850a00, 0xc424c88f00, 0xc428fe5320)\n\t/go/src/google.golang.org/grpc/stream.go:197 +0x426\ncreated by google.golang.org/grpc.NewClientStream\n\t/go/src/google.golang.org/grpc/stream.go:217 +0xb5f\n\ngoroutine 20818 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).processQueue(0xc429f7ff80, 0xc400000001, 0xc42d5cbec0, 0xc42d344a40, 0x2535d00, 0xc428c84b60, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:496 +0x65d\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).connectAndProcess.func1(0xc429f7ff80, 0x1, 0x7f6332868108, 0xc420014588, 0x0, 0x0, 0xc42d34e090, 0xc42d5cbec0, 0xc42d344a40, 0x0, ...)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:440 +0x388\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).connectAndProcess(0xc429f7ff80, 0x7f6332868108, 0xc420014588, 0x7f6300000001, 0xc42d5cbec0, 0xc42d344a40)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:441 +0x105\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).SendAsync.func2.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:576 +0xd6\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc4278b8b10)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20717 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).processQueue(0xc425d16f00, 0x7f6300000002, 0xc42e617c80, 0xc42e856bc0, 0x2535d00, 0xc428b8d3c0, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:496 +0x65d\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).connectAndProcess.func1(0xc425d16f00, 0x2, 0x7f6332868108, 0xc420014588, 0x1, 0x0, 0xc42c0d1e60, 0xc42e617c80, 0xc42e856bc0, 0x0, ...)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:440 +0x388\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).connectAndProcess(0xc425d16f00, 0x7f6332868108, 0xc420014588, 0x7f6300000002, 0xc42e617c80, 0xc42e856bc0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:441 +0x105\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).SendAsync.func2.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:576 +0xd6\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc428b8fb00)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20556 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*Store).startCoalescedHeartbeatsLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:3315 +0x167\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc426b10e00)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20785 [select]:\ngoogle.golang.org/grpc/transport.(*recvBufferReader).Read(0xc42cd46440, 0xc424997cb0, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a\ngoogle.golang.org/grpc/transport.(*Stream).Read(0xc42814dc20, 0xc424997cb0, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:314 +0x59\nio.ReadAtLeast(0x251b040, 0xc42814dc20, 0xc424997cb0, 0x5, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x251b040, 0xc42814dc20, 0xc424997cb0, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngoogle.golang.org/grpc.(*parser).recvMsg(0xc424997ca0, 0x7fffffff, 0x0, 0x18, 0x1bae031, 0x1bae030, 0xc41fd1f9bb, 0x0)\n\t/go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f\ngoogle.golang.org/grpc.recv(0xc424997ca0, 0x252ce40, 0x2a27c00, 0xc42814dc20, 0x0, 0x0, 0x1908a20, 0xc425c0c860, 0x7fffffff, 0xc425afe901, ...)\n\t/go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d\ngoogle.golang.org/grpc.(*serverStream).RecvMsg(0xc42d34e120, 0x1908a20, 0xc425c0c860, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/stream.go:492 +0xec\ngithub.com/cockroachdb/cockroach/pkg/storage.(*multiRaftRaftMessageBatchServer).Recv(0xc425afe920, 0x7f63327d1130, 0xc4278b9020, 0xc428ed8600)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft.pb.go:346 +0x62\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).RaftMessageBatch.func1.1.1(0x2534860, 0xc425afe920, 0xc425d16f00, 0xc42189c788, 0xc42189c790)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:301 +0x45\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).RaftMessageBatch.func1.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:324 +0x45\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc429cff050)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20531 [select]:\ngoogle.golang.org/grpc.(*addrConn).transportMonitor(0xc427ba0f00)\n\t/go/src/google.golang.org/grpc/clientconn.go:720 +0x63e\ncreated by google.golang.org/grpc.(*ClientConn).resetAddrConn\n\t/go/src/google.golang.org/grpc/clientconn.go:467 +0x6e2\n\ngoroutine 20543 [semacquire]:\nsync.runtime_notifyListWait(0xc42016a010, 0xc4000001f5)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42016a000)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc426406aa0, 0xc42e9dd680)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc425e44720)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20704 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*Store).startCoalescedHeartbeatsLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:3315 +0x167\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc426b11f10)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20538 [semacquire]:\nsync.runtime_notifyListWait(0xc42016a010, 0xc4000001ed)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42016a000)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc426406aa0, 0xc42e9dd680)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc425e44640)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20666 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*server).start.func3()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:381 +0x66\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc429c8e4c0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20557 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:171 +0x55\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc425e45180)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20512 [IO wait]:\nnet.runtime_pollWait(0x7f6331627218, 0x72, 0xa)\n\t/usr/local/go/src/runtime/netpoll.go:160 +0x59\nnet.(*pollDesc).wait(0xc422b10ae0, 0x72, 0xc4245c78e8, 0xc420014240)\n\t/usr/local/go/src/net/fd_poll_runtime.go:73 +0x38\nnet.(*pollDesc).waitRead(0xc422b10ae0, 0x251f040, 0xc420014240)\n\t/usr/local/go/src/net/fd_poll_runtime.go:78 +0x34\nnet.(*netFD).Read(0xc422b10a80, 0xc42d3a2000, 0x8000, 0x8000, 0x0, 0x251f040, 0xc420014240)\n\t/usr/local/go/src/net/fd_unix.go:243 +0x1a1\nnet.(*conn).Read(0xc421cdd7a8, 0xc42d3a2000, 0x8000, 0x8000, 0x0, 0x0, 0x0)\n\t/usr/local/go/src/net/net.go:173 +0x70\nbufio.(*Reader).fill(0xc429f7f8c0)\n\t/usr/local/go/src/bufio/bufio.go:97 +0x10c\nbufio.(*Reader).Read(0xc429f7f8c0, 0xc424b79a78, 0x9, 0x9, 0x60c180, 0xc430226200, 0xc429224de0)\n\t/usr/local/go/src/bufio/bufio.go:209 +0x1bc\nio.ReadAtLeast(0x2516200, 0xc429f7f8c0, 0xc424b79a78, 0x9, 0x9, 0x9, 0xc4245c7af8, 0x6203c0, 0xc42a265500)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x2516200, 0xc429f7f8c0, 0xc424b79a78, 0x9, 0x9, 0xc430226200, 0x2, 0x4)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngolang.org/x/net/http2.readFrameHeader(0xc424b79a78, 0x9, 0x9, 0x2516200, 0xc429f7f8c0, 0x0, 0xc400000000, 0xc4245c7c90, 0xda591c)\n\t/go/src/golang.org/x/net/http2/frame.go:237 +0x7b\ngolang.org/x/net/http2.(*Framer).ReadFrame(0xc424b79a40, 0x3b, 0x3b, 0x0, 0x0)\n\t/go/src/golang.org/x/net/http2/frame.go:464 +0xa4\ngoogle.golang.org/grpc/transport.(*framer).readFrame(0xc427e45e90, 0xc42ffc4a80, 0xc42ffc4a80, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/http_util.go:505 +0x2f\ngoogle.golang.org/grpc/transport.(*http2Server).HandleStreams(0xc42630bb90, 0xc427e45f50)\n\t/go/src/google.golang.org/grpc/transport/http2_server.go:260 +0x200\ngoogle.golang.org/grpc.(*Server).serveStreams(0xc42a6801e0, 0x2534c20, 0xc42630bb90)\n\t/go/src/google.golang.org/grpc/server.go:424 +0x160\ngoogle.golang.org/grpc.(*Server).serveNewHTTP2Transport(0xc42a6801e0, 0x2535e80, 0xc421cdd7a8, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/server.go:411 +0x3da\ngoogle.golang.org/grpc.(*Server).handleRawConn(0xc42a6801e0, 0x2535e80, 0xc421cdd7a8)\n\t/go/src/google.golang.org/grpc/server.go:388 +0x470\ncreated by google.golang.org/grpc.(*Server).Serve\n\t/go/src/google.golang.org/grpc/server.go:357 +0x1a9\n\ngoroutine 20447 [select]:\ngoogle.golang.org/grpc/transport.(*http2Server).controller(0xc4268b4900)\n\t/go/src/google.golang.org/grpc/transport/http2_server.go:673 +0x69c\ncreated by google.golang.org/grpc/transport.newHTTP2Server\n\t/go/src/google.golang.org/grpc/transport/http2_server.go:139 +0x767\n\ngoroutine 20585 [select]:\ngithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).runHeartbeat(0xc42307fb80, 0xc4299cc900, 0xc427d00910, 0xf, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:292 +0x617\ngithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).GRPCDial.func1.1.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:227 +0x69\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc42c245d10)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20591 [semacquire]:\nsync.runtime_notifyListWait(0xc42cc74550, 0xc40000021a)\n\t/usr/local/go/src/runtime/sema.go:267 +0x122\nsync.(*Cond).Wait(0xc42cc74540)\n\t/usr/local/go/src/sync/cond.go:57 +0x80\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).worker(0xc42a680b40, 0xc42e613a70)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:212 +0xb2\ngithub.com/cockroachdb/cockroach/pkg/storage.(*raftScheduler).Start.func2()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scheduler.go:181 +0x33\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e613a70, 0xc425582a00)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20659 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*replicaScanner).waitAndProcess(0xc42bf73860, 0x7f6332868108, 0xc420014588, 0xecfc4bf38, 0xc41dfe81e8, 0x29eafc0, 0xc420398080, 0xc42e613a70, 0x0, 0xc4286e7f38)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scanner.go:207 +0x254\ngithub.com/cockroachdb/cockroach/pkg/storage.(*replicaScanner).scanLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/scanner.go:274 +0x3ee\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e613a70, 0xc426f19f20)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20617 [select]:\ngoogle.golang.org/grpc/transport.(*recvBufferReader).Read(0xc42d7a0640, 0xc426e14110, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a\ngoogle.golang.org/grpc/transport.(*Stream).Read(0xc42c77d4a0, 0xc426e14110, 0x5, 0x5, 0x183c2e0, 0xc4232fd470, 0x30)\n\t/go/src/google.golang.org/grpc/transport/transport.go:314 +0x59\nio.ReadAtLeast(0x251b040, 0xc42c77d4a0, 0xc426e14110, 0x5, 0x5, 0x5, 0xc42708cd50, 0x0, 0xc42708cd80)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x251b040, 0xc42c77d4a0, 0xc426e14110, 0x5, 0x5, 0xc400000001, 0x0, 0x5da0c9)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngoogle.golang.org/grpc.(*parser).recvMsg(0xc426e14100, 0x7fffffff, 0x0, 0x38, 0x1bae08c, 0x1bae08b, 0xc41f8e1cc3, 0x0)\n\t/go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f\ngoogle.golang.org/grpc.recv(0xc426e14100, 0x252ce40, 0x2a27c00, 0xc42c77d4a0, 0x0, 0x0, 0x1914760, 0xc42e3c6740, 0x7fffffff, 0xc420055b01, ...)\n\t/go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d\ngoogle.golang.org/grpc.(*serverStream).RecvMsg(0xc4268b50e0, 0x1914760, 0xc42e3c6740, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/stream.go:492 +0xec\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*gossipGossipServer).Recv(0xc426af3fa0, 0xd93b6c, 0x183c2e0, 0xc4232fd470)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/gossip.pb.go:228 +0x62\ngithub.com/cockroachdb/cockroach/pkg/gossip.(Gossip_GossipServer).Recv-fm(0xc4232fd470, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:153 +0x2f\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*server).gossipReceiver(0xc4232fd440, 0x7f63327d10b8, 0xc42d7a06c0, 0xc420127ca8, 0xc42d7a0700, 0xc420055f40, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:321 +0x413\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*server).Gossip.func3.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:153 +0x99\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc42424f270)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20766 [select]:\ngoogle.golang.org/grpc/transport.(*recvBufferReader).Read(0xc42e42f9c0, 0xc428d9bf50, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a\ngoogle.golang.org/grpc/transport.(*Stream).Read(0xc424c89b30, 0xc428d9bf50, 0x5, 0x5, 0xd93fb3, 0x4, 0x18a9060)\n\t/go/src/google.golang.org/grpc/transport/transport.go:314 +0x59\nio.ReadAtLeast(0x251b040, 0xc424c89b30, 0xc428d9bf50, 0x5, 0x5, 0x5, 0x4, 0x183c2e0, 0xc42bf73d38)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x251b040, 0xc424c89b30, 0xc428d9bf50, 0x5, 0x5, 0x8952fb, 0xc42ced0960, 0xc400000001)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngoogle.golang.org/grpc.(*parser).recvMsg(0xc428d9bf40, 0x7fffffff, 0x2, 0x2, 0x2, 0x1200000000, 0x2, 0x2)\n\t/go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f\ngoogle.golang.org/grpc.recv(0xc428d9bf40, 0x252ce40, 0x2a27c00, 0xc424c89b30, 0x0, 0x0, 0x1908b00, 0xc427ae6c00, 0x7fffffff, 0xc42054a000, ...)\n\t/go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d\ngoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc421fc9440, 0x1908b00, 0xc427ae6c00, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/stream.go:305 +0xc4\ngithub.com/cockroachdb/cockroach/pkg/storage.(*multiRaftRaftMessageBatchClient).Recv(0xc426dec850, 0x5dbdf8, 0x10, 0x1873380)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft.pb.go:278 +0x62\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).processQueue.func1.1.1(0x2535d00, 0xc426dec850, 0xc424339500, 0xc424d2b800, 0x7f6332868108, 0xc420014588, 0xadf36f, 0xc4244adf88)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:468 +0x56\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).processQueue.func1.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:485 +0xdd\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc426bba600)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20501 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*baseQueue).processLoop.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/queue.go:451 +0x357\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd680, 0xc426f19640)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20719 [select]:\ngoogle.golang.org/grpc/transport.(*recvBufferReader).Read(0xc42e857400, 0xc427332fd0, 0x5, 0x5, 0x0, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/transport/transport.go:141 +0x69a\ngoogle.golang.org/grpc/transport.(*Stream).Read(0xc423ba6690, 0xc427332fd0, 0x5, 0x5, 0x1, 0x2, 0xd93e4b)\n\t/go/src/google.golang.org/grpc/transport/transport.go:314 +0x59\nio.ReadAtLeast(0x251b040, 0xc423ba6690, 0xc427332fd0, 0x5, 0x5, 0x5, 0x4, 0x183c2e0, 0xc42bf73d38)\n\t/usr/local/go/src/io/io.go:307 +0xa4\nio.ReadFull(0x251b040, 0xc423ba6690, 0xc427332fd0, 0x5, 0x5, 0x2, 0xc4244a9468, 0x5d9947)\n\t/usr/local/go/src/io/io.go:325 +0x58\ngoogle.golang.org/grpc.(*parser).recvMsg(0xc427332fc0, 0x7fffffff, 0x2516940, 0xc4232fd440, 0xc4244a9590, 0xa91f52, 0x1970d80, 0xc4232fd440)\n\t/go/src/google.golang.org/grpc/rpc_util.go:231 +0x6f\ngoogle.golang.org/grpc.recv(0xc427332fc0, 0x252ce40, 0x2a27c00, 0xc423ba6690, 0x0, 0x0, 0x1908b00, 0xc428b8fc50, 0x7fffffff, 0xc420265c00, ...)\n\t/go/src/google.golang.org/grpc/rpc_util.go:315 +0x4d\ngoogle.golang.org/grpc.(*clientStream).RecvMsg(0xc42dd4ca20, 0x1908b00, 0xc428b8fc50, 0x0, 0x0)\n\t/go/src/google.golang.org/grpc/stream.go:305 +0xc4\ngithub.com/cockroachdb/cockroach/pkg/storage.(*multiRaftRaftMessageBatchClient).Recv(0xc428b8d3c0, 0x5dbdf8, 0x10, 0x1873380)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft.pb.go:278 +0x62\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).processQueue.func1.1.1(0x2535d00, 0xc428b8d3c0, 0xc42e856bc0, 0xc425d16f00, 0x7f6332868108, 0xc420014588, 0xadf36f, 0xc4244a9788)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:468 +0x56\ngithub.com/cockroachdb/cockroach/pkg/storage.(*RaftTransport).processQueue.func1.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/raft_transport.go:485 +0xdd\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc428b8fc20)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20665 [select]:\ngithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).runHeartbeat(0xc42307fb80, 0xc4289a6f00, 0xc428a60c60, 0xf, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:292 +0x617\ngithub.com/cockroachdb/cockroach/pkg/rpc.(*Context).GRPCDial.func1.1.1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:227 +0x69\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc428af9e30)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20656 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*StorePool).start.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store_pool.go:353 +0x3de\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc426e157a0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20586 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*server).start.func3()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/server.go:381 +0x66\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc425582940)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20478 [chan receive]:\ngithub.com/cockroachdb/cockroach/pkg/storage/engine.(*RocksDB).open.func1(0xc42ca6e7d0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/rocksdb.go:373 +0x44\ncreated by github.com/cockroachdb/cockroach/pkg/storage/engine.(*RocksDB).open\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/engine/rocksdb.go:374 +0x702\n\ngoroutine 20631 [select]:\ngithub.com/cockroachdb/cockroach/pkg/storage.(*Store).Start.func3()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/storage/store.go:1149 +0x165\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42630bd40, 0xc428d9a480)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\ngoroutine 20636 [select]:\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*client).gossip(0xc421161e40, 0x7f63327d10b8, 0xc42def3f80, 0xc42e790180, 0x2535100, 0xc426a270f0, 0xc42e9dd560, 0xc429af4ad0, 0x0, 0x0)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/client.go:309 +0x3ec\ngithub.com/cockroachdb/cockroach/pkg/gossip.(*client).start.func1()\n\t/go/src/github.com/cockroachdb/cockroach/pkg/gossip/client.go:126 +0x4f7\ngithub.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker.func1(0xc42e9dd560, 0xc42a4be180)\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:196 +0x7d\ncreated by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunWorker\n\t/go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:197 +0x66\n\n\nERROR: exit status 2\n\nmake: *** [stress] Error 1\n1 runs completed, 1 failures, over 1m33s\nFAIL\nMakefile:128: recipe for target 'stress' failed\n\n```"}}
{"actor":{"display_login":"tamird"}}