{"action":"created","issue":{"url":"https://api.github.com/repos/tendermint/tendermint/issues/2965","repository_url":"https://api.github.com/repos/tendermint/tendermint","labels_url":"https://api.github.com/repos/tendermint/tendermint/issues/2965/labels{/name}","comments_url":"https://api.github.com/repos/tendermint/tendermint/issues/2965/comments","events_url":"https://api.github.com/repos/tendermint/tendermint/issues/2965/events","html_url":"https://github.com/tendermint/tendermint/issues/2965","id":387315386,"node_id":"MDU6SXNzdWUzODczMTUzODY=","number":2965,"title":"consensus failure while benchmarking kvstore app (gRPC, no empty blocks)","user":{"login":"melekes","id":1282182,"node_id":"MDQ6VXNlcjEyODIxODI=","avatar_url":"https://avatars2.githubusercontent.com/u/1282182?v=4","gravatar_id":"","url":"https://api.github.com/users/melekes","html_url":"https://github.com/melekes","followers_url":"https://api.github.com/users/melekes/followers","following_url":"https://api.github.com/users/melekes/following{/other_user}","gists_url":"https://api.github.com/users/melekes/gists{/gist_id}","starred_url":"https://api.github.com/users/melekes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/melekes/subscriptions","organizations_url":"https://api.github.com/users/melekes/orgs","repos_url":"https://api.github.com/users/melekes/repos","events_url":"https://api.github.com/users/melekes/events{/privacy}","received_events_url":"https://api.github.com/users/melekes/received_events","type":"User","site_admin":false},"labels":[{"id":99653654,"node_id":"MDU6TGFiZWw5OTY1MzY1NA==","url":"https://api.github.com/repos/tendermint/tendermint/labels/bug","name":"bug","color":"fad2fa","default":true},{"id":795907908,"node_id":"MDU6TGFiZWw3OTU5MDc5MDg=","url":"https://api.github.com/repos/tendermint/tendermint/labels/consensus","name":"consensus","color":"fafad2","default":false},{"id":804496251,"node_id":"MDU6TGFiZWw4MDQ0OTYyNTE=","url":"https://api.github.com/repos/tendermint/tendermint/labels/help%20wanted","name":"help wanted","color":"e6fad2","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-12-04T14:35:47Z","updated_at":"2018-12-15T20:02:55Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"no empty blocks, skip_timeout_commit, cleveldb, gRPC server/client\r\ntendermint 0.27.0-d9a1aad5\r\n\r\nE[4126-12-04|14:14:41.953] CONSENSUS FAILURE!!!                         module=consensus err=\"runtime error: invalid memory address or nil pointer dereference\" stack=\"goroutine 68 [running]:\\nruntime/debug.Stack(0xc0034283c0, 0xd363c0, 0x19284d0)\\n\\t/usr/local/go/src/runtime/debug/stack.go:24 +0xa7\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).receiveRoutine.func2(0xc000888380, 0xfab6d0)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:576 +0x57\\npanic(0xd363c0, 0x19284d0)\\n\\t/usr/local/go/src/runtime/panic.go:513 +0x1b9\\ngithub.com/tendermint/tendermint/types.NewResultFromResponse(...)\\n\\t/root/go/src/github.com/tendermint/tendermint/types/results.go:44\\ngithub.com/tendermint/tendermint/types.NewResults(0xc002da0000, 0x183a, 0x183a, 0xc003918dc0, 0xc001d6c2b8, 0xc0027dc2d0)\\n\\t/root/go/src/github.com/tendermint/tendermint/types/results.go:36 +0x6b\\ngithub.com/tendermint/tendermint/state.(*ABCIResponses).ResultsHash(0xc004013710, 0xc0027dc5a0, 0xb602ec, 0xc0034285c8)\\n\\t/root/go/src/github.com/tendermint/tendermint/state/store.go:133 +0x40\\ngithub.com/tendermint/tendermint/state.updateState(0x8, 0x1, 0xc00095286a, 0x6, 0xc000877640, 0x11, 0xd, 0x5a57, 0xc0026f3840, 0x20, ...)\\n\\t/root/go/src/github.com/tendermint/tendermint/state/execution.go:469 +0x3c6\\ngithub.com/tendermint/tendermint/state.(*BlockExecutor).ApplyBlock(0xc000954380, 0x8, 0x1, 0xc00095286a, 0x6, 0xc000877640, 0x11, 0xd, 0x5a57, 0xc0026f3840, ...)\\n\\t/root/go/src/github.com/tendermint/tendermint/state/execution.go:125 +0x50b\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).finalizeCommit(0xc000888380, 0xe)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:1290 +0xa8c\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).tryFinalizeCommit(0xc000888380, 0xe)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:1221 +0x451\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).enterCommit.func1(0xc000888380, 0x0, 0xe)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:1167 +0x90\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).enterCommit(0xc000888380, 0xe, 0x0)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:1198 +0x6b8\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).addVote(0xc000888380, 0xc0022117c0, 0x0, 0x0, 0x488edd, 0xc0014e7bc0, 0xc000a64100)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:1622 +0xc03\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).tryAddVote(0xc000888380, 0xc0022117c0, 0x0, 0x0, 0x42f272, 0xc000000008, 0xc003429b80)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:1469 +0x59\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).handleMsg(0xc000888380, 0x10673a0, 0xc001d6c0d0, 0x0, 0x0)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:650 +0x696\\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).receiveRoutine(0xc000888380, 0x0)\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:611 +0x555\\ncreated by github.com/tendermint/tendermint/consensus.(*ConsensusState).OnStart\\n\\t/root/go/src/github.com/tendermint/tendermint/consensus/state.go:300 +0x132\\n\""},"comment":{"url":"https://api.github.com/repos/tendermint/tendermint/issues/comments/447594204","html_url":"https://github.com/tendermint/tendermint/issues/2965#issuecomment-447594204","issue_url":"https://api.github.com/repos/tendermint/tendermint/issues/2965","id":447594204,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0NzU5NDIwNA==","user":{"login":"ebuchman","id":2300911,"node_id":"MDQ6VXNlcjIzMDA5MTE=","avatar_url":"https://avatars3.githubusercontent.com/u/2300911?v=4","gravatar_id":"","url":"https://api.github.com/users/ebuchman","html_url":"https://github.com/ebuchman","followers_url":"https://api.github.com/users/ebuchman/followers","following_url":"https://api.github.com/users/ebuchman/following{/other_user}","gists_url":"https://api.github.com/users/ebuchman/gists{/gist_id}","starred_url":"https://api.github.com/users/ebuchman/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ebuchman/subscriptions","organizations_url":"https://api.github.com/users/ebuchman/orgs","repos_url":"https://api.github.com/users/ebuchman/repos","events_url":"https://api.github.com/users/ebuchman/events{/privacy}","received_events_url":"https://api.github.com/users/ebuchman/received_events","type":"User","site_admin":false},"created_at":"2018-12-15T20:02:55Z","updated_at":"2018-12-15T20:02:55Z","author_association":"CONTRIBUTOR","body":"> some of the DeliverTxAsync calls are still pending\r\n\r\nThis shouldn't be possible because EndBlock is called synchronously, which should result in all pending ABCI requests completing. Maybe there's a bug in the GRPC client/server that makes this not true? Is this non-deterministic?"}}
{"actor":{"display_login":"ebuchman"}}