{"action":"created","issue":{"url":"https://api.github.com/repos/tendermint/tendermint/issues/1835","repository_url":"https://api.github.com/repos/tendermint/tendermint","labels_url":"https://api.github.com/repos/tendermint/tendermint/issues/1835/labels{/name}","comments_url":"https://api.github.com/repos/tendermint/tendermint/issues/1835/comments","events_url":"https://api.github.com/repos/tendermint/tendermint/issues/1835/events","html_url":"https://github.com/tendermint/tendermint/issues/1835","id":336934054,"node_id":"MDU6SXNzdWUzMzY5MzQwNTQ=","number":1835,"title":"Tendermint shows time dependent performance degredation","user":{"login":"z-bowen","id":16962398,"node_id":"MDQ6VXNlcjE2OTYyMzk4","avatar_url":"https://avatars1.githubusercontent.com/u/16962398?v=4","gravatar_id":"","url":"https://api.github.com/users/z-bowen","html_url":"https://github.com/z-bowen","followers_url":"https://api.github.com/users/z-bowen/followers","following_url":"https://api.github.com/users/z-bowen/following{/other_user}","gists_url":"https://api.github.com/users/z-bowen/gists{/gist_id}","starred_url":"https://api.github.com/users/z-bowen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/z-bowen/subscriptions","organizations_url":"https://api.github.com/users/z-bowen/orgs","repos_url":"https://api.github.com/users/z-bowen/repos","events_url":"https://api.github.com/users/z-bowen/events{/privacy}","received_events_url":"https://api.github.com/users/z-bowen/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-06-29T09:45:23Z","updated_at":"2018-06-29T16:13:38Z","closed_at":null,"author_association":"NONE","body":"**BUG REPORT**\r\n\r\n**Tendermint version**: 0.20.0-27bd1dea\r\n\r\n**Environment**:\r\n- **OS**: Ubuntu 18.04 LTS (Bionic Beaver)\r\n- **Processor**: Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz (10 cores)\r\n- **Memory**: 15GB\r\n\r\n\r\n**What happened**:\r\nThe tm-bench tool shows a performance degradation over time. Initially, I can get performance on the order of 2000tx/s, but this drops off rapidly as the test duration increases. After 1000s, I see transaction rates of only ~200tx/s, and this continues to fall as the test duration increases.\r\n\r\n**What you expected to happen**:\r\nTendermint transaction rates should be consistent, regardless of test duration.\r\n\r\n**How to reproduce it**:\r\nA detailed report of the study can be found [here](https://github.com/bigchaindb/BEPs/tree/ecdf09868be7b8c922f893aa09e1acdd1e0d5912/19)\r\n\r\nThis report contains scripts to reproduce the problem, as well as the config.toml from the test runs.\r\n\r\n**Anything else do we need to know**:\r\nI'll be out of the office and unable to check emails for the next week, but I'll be happy to communicate with your team about this issue when I'm back on 9.7.18"},"comment":{"url":"https://api.github.com/repos/tendermint/tendermint/issues/comments/401402231","html_url":"https://github.com/tendermint/tendermint/issues/1835#issuecomment-401402231","issue_url":"https://api.github.com/repos/tendermint/tendermint/issues/1835","id":401402231,"node_id":"MDEyOklzc3VlQ29tbWVudDQwMTQwMjIzMQ==","user":{"login":"ValarDragon","id":6440154,"node_id":"MDQ6VXNlcjY0NDAxNTQ=","avatar_url":"https://avatars1.githubusercontent.com/u/6440154?v=4","gravatar_id":"","url":"https://api.github.com/users/ValarDragon","html_url":"https://github.com/ValarDragon","followers_url":"https://api.github.com/users/ValarDragon/followers","following_url":"https://api.github.com/users/ValarDragon/following{/other_user}","gists_url":"https://api.github.com/users/ValarDragon/gists{/gist_id}","starred_url":"https://api.github.com/users/ValarDragon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ValarDragon/subscriptions","organizations_url":"https://api.github.com/users/ValarDragon/orgs","repos_url":"https://api.github.com/users/ValarDragon/repos","events_url":"https://api.github.com/users/ValarDragon/events{/privacy}","received_events_url":"https://api.github.com/users/ValarDragon/received_events","type":"User","site_admin":false},"created_at":"2018-06-29T16:13:38Z","updated_at":"2018-06-29T16:13:38Z","author_association":"MEMBER","body":"We've recently created patches to tm-bench to fix this. There was an issue with the tm-bench code. (Basically stats were only being collected from the last 20 blocks, not over all blocks in that duration) Thanks for making the report, its awesome!\r\n\r\nThe graphs you made look roughly like a `1/x` curve which is what we'd expect since tm-bench was only reading the last 20 blocks"}}
{"actor":{"display_login":"ValarDragon"}}