{"action":"created","issue":{"url":"https://api.github.com/repos/sysown/proxysql/issues/1632","repository_url":"https://api.github.com/repos/sysown/proxysql","labels_url":"https://api.github.com/repos/sysown/proxysql/issues/1632/labels{/name}","comments_url":"https://api.github.com/repos/sysown/proxysql/issues/1632/comments","events_url":"https://api.github.com/repos/sysown/proxysql/issues/1632/events","html_url":"https://github.com/sysown/proxysql/issues/1632","id":346876838,"node_id":"MDU6SXNzdWUzNDY4NzY4Mzg=","number":1632,"title":"ProxySQL dropping connection during backend server master failover","user":{"login":"chaithanyaganta","id":7595101,"node_id":"MDQ6VXNlcjc1OTUxMDE=","avatar_url":"https://avatars3.githubusercontent.com/u/7595101?v=4","gravatar_id":"","url":"https://api.github.com/users/chaithanyaganta","html_url":"https://github.com/chaithanyaganta","followers_url":"https://api.github.com/users/chaithanyaganta/followers","following_url":"https://api.github.com/users/chaithanyaganta/following{/other_user}","gists_url":"https://api.github.com/users/chaithanyaganta/gists{/gist_id}","starred_url":"https://api.github.com/users/chaithanyaganta/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chaithanyaganta/subscriptions","organizations_url":"https://api.github.com/users/chaithanyaganta/orgs","repos_url":"https://api.github.com/users/chaithanyaganta/repos","events_url":"https://api.github.com/users/chaithanyaganta/events{/privacy}","received_events_url":"https://api.github.com/users/chaithanyaganta/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-08-02T06:30:46Z","updated_at":"2018-08-02T14:35:21Z","closed_at":null,"author_association":"NONE","body":"During backend server master failover (ie., in the target host group all the write nodes are either offline soft or offline hard), write queries are failing due to time-out from backend server (_**2013, 'Lost connection to MySQL server during query (timed out)**_). But, front-end proxysql connection is getting dropped immediately. We need to reconnect to query again.\r\nAlthough `mysql-connect_retries_on_failure` is set to 10, it is returning after a single failure.\r\n\r\nTransition of nodes status during this failover:\r\n\r\nInitial:\r\nMaster - ONLINE\r\nStandBy - OFFLINE_SOFT\r\n\r\nDuring failover (this is where we are getting query timeouts):\r\nMaster - OFFLINE_HARD\r\nStandBy - OFFLINE_SOFT \r\n\r\nAfter failover:\r\nMaster - OFFLINE_HARD\r\nStandBy(new Master) - ONLINE\r\n\r\nProxySQL version: **v1.4.9-1.1.el7**"},"comment":{"url":"https://api.github.com/repos/sysown/proxysql/issues/comments/409948646","html_url":"https://github.com/sysown/proxysql/issues/1632#issuecomment-409948646","issue_url":"https://api.github.com/repos/sysown/proxysql/issues/1632","id":409948646,"node_id":"MDEyOklzc3VlQ29tbWVudDQwOTk0ODY0Ng==","user":{"login":"renecannao","id":3645227,"node_id":"MDQ6VXNlcjM2NDUyMjc=","avatar_url":"https://avatars3.githubusercontent.com/u/3645227?v=4","gravatar_id":"","url":"https://api.github.com/users/renecannao","html_url":"https://github.com/renecannao","followers_url":"https://api.github.com/users/renecannao/followers","following_url":"https://api.github.com/users/renecannao/following{/other_user}","gists_url":"https://api.github.com/users/renecannao/gists{/gist_id}","starred_url":"https://api.github.com/users/renecannao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/renecannao/subscriptions","organizations_url":"https://api.github.com/users/renecannao/orgs","repos_url":"https://api.github.com/users/renecannao/repos","events_url":"https://api.github.com/users/renecannao/events{/privacy}","received_events_url":"https://api.github.com/users/renecannao/received_events","type":"User","site_admin":false},"created_at":"2018-08-02T14:35:21Z","updated_at":"2018-08-02T14:35:21Z","author_association":"CONTRIBUTOR","body":"@chaithanyaganta , please provide a reproducible test case.\r\nIt is possible you aren't doing the failover correctly, or something else is happening.\r\nFor completeness, below is an example of how it works successfully using `sysbench`.\r\n\r\n## Using sysbench with no transactions and performing a non graceful failover\r\n\r\nStarting point:\r\n```\r\nmysql> SELECT hostgroup_id, hostname, port, status FROM mysql_servers;                                                                                            +--------------+-----------+-------+--------------+\r\n| hostgroup_id | hostname  | port  | status       |\r\n+--------------+-----------+-------+--------------+\r\n| 1            | 127.0.0.1 | 17822 | ONLINE       |\r\n| 1            | 127.0.0.1 | 17823 | OFFLINE_SOFT |\r\n+--------------+-----------+-------+--------------+\r\n2 rows in set (0,00 sec)\r\n```\r\n\r\nRunning sysbench:\r\n```\r\n../sysbench oltp_read_write.lua --threads=16 --report-interval=1 --max-requests=0 \\\r\n--time=30 --mysql-host=127.0.0.1 --mysql-user=sbtest --mysql-password=sbtest \\\r\n--table-size=1000000 --db-ps-mode=disable --mysql-ignore-errors=1062 \\\r\n--skip-trx=on --mysql-port=6033 run\r\n```\r\nNote: sysbench is ignoring duplicate key error (1062) because they are expected to happen when `--skip-trx=on` is used.\r\n\r\nPerforming the failover as you described it:\r\n```\r\nmysql> UPDATE mysql_servers SET status='OFFLINE_HARD' WHERE port=17822; SELECT hostgroup_id, hostname, port, status FROM mysql_servers; LOAD MYSQL SERVERS TO RUNTIME;\r\nQuery OK, 1 row affected (0,00 sec)\r\n\r\n+--------------+-----------+-------+--------------+\r\n| hostgroup_id | hostname  | port  | status       |\r\n+--------------+-----------+-------+--------------+\r\n| 1            | 127.0.0.1 | 17822 | OFFLINE_HARD |\r\n| 1            | 127.0.0.1 | 17823 | OFFLINE_SOFT |\r\n+--------------+-----------+-------+--------------+\r\n2 rows in set (0,00 sec)\r\n\r\nQuery OK, 0 rows affected (0,00 sec)\r\n```\r\n... and after few seconds:\r\n```\r\nmysql> UPDATE mysql_servers SET status='ONLINE' WHERE port=17823; SELECT hostgroup_id, hostname, port, status FROM mysql_servers; LOAD MYSQL SERVERS TO RUNTIME;\r\nQuery OK, 1 row affected (0,00 sec)\r\n\r\n+--------------+-----------+-------+--------------+\r\n| hostgroup_id | hostname  | port  | status       |\r\n+--------------+-----------+-------+--------------+\r\n| 1            | 127.0.0.1 | 17822 | OFFLINE_HARD |\r\n| 1            | 127.0.0.1 | 17823 | ONLINE       |\r\n+--------------+-----------+-------+--------------+\r\n2 rows in set (0,00 sec)\r\n\r\nQuery OK, 0 rows affected (0,01 sec)\r\n```\r\n\r\nOutput of sysbench:\r\n```\r\n../sysbench oltp_read_write.lua --threads=16 --report-interval=1 --max-requests=0 --time=30 --mysql-host=127.0.0.1 --mysql-user=sbtest --mysql-password=sbtest --table-size=1000000 --db-ps-mode=disable --mysql-ignore-errors=1062 --skip-trx=on --mysql-port=6033 run\r\nsysbench 1.1.0-81ae246 (using bundled LuaJIT 2.1.0-beta3)\r\n\r\nRunning the test with following options:\r\nNumber of threads: 16\r\nReport intermediate results every 1 second(s)\r\nInitializing random number generator from current time\r\n\r\n\r\nInitializing worker threads...\r\n\r\nThreads started!\r\n\r\n[ 1s ] thds: 16 tps: 281.03 qps: 5301.70 (r/w/o: 4152.67/1149.03/0.00) lat (ms,95%): 77.19 err/s: 0.00 reconn/s: 0.00\r\n[ 2s ] thds: 16 tps: 282.13 qps: 5084.27 (r/w/o: 3954.77/1129.51/0.00) lat (ms,95%): 95.81 err/s: 0.00 reconn/s: 0.00\r\n[ 3s ] thds: 16 tps: 337.98 qps: 6062.65 (r/w/o: 4713.73/1348.92/0.00) lat (ms,95%): 66.84 err/s: 0.00 reconn/s: 0.00\r\n[ 4s ] thds: 16 tps: 321.98 qps: 5822.57 (r/w/o: 4525.67/1295.90/1.00) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00\r\n[ 5s ] thds: 16 tps: 380.03 qps: 6824.52 (r/w/o: 5319.40/1503.11/2.00) lat (ms,95%): 50.11 err/s: 0.00 reconn/s: 0.00\r\n[ 6s ] thds: 16 tps: 342.93 qps: 6181.70 (r/w/o: 4801.99/1378.71/1.00) lat (ms,95%): 59.99 err/s: 0.00 reconn/s: 0.00\r\n[ 7s ] thds: 16 tps: 293.08 qps: 5246.36 (r/w/o: 4086.06/1159.30/1.00) lat (ms,95%): 64.47 err/s: 0.00 reconn/s: 0.00\r\n[ 8s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 9s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 10s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 11s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 12s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 13s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 14s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 15s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 16s ] thds: 16 tps: 137.00 qps: 2481.91 (r/w/o: 1930.93/550.98/0.00) lat (ms,95%): 8795.93 err/s: 1.00 reconn/s: 0.00\r\n[ 17s ] thds: 16 tps: 313.01 qps: 5638.10 (r/w/o: 4382.08/1256.02/0.00) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00\r\n[ 18s ] thds: 16 tps: 330.01 qps: 5882.11 (r/w/o: 4569.09/1313.03/0.00) lat (ms,95%): 86.00 err/s: 0.00 reconn/s: 0.00\r\n[ 19s ] thds: 16 tps: 345.99 qps: 6286.83 (r/w/o: 4888.87/1397.96/0.00) lat (ms,95%): 61.08 err/s: 0.00 reconn/s: 0.00\r\n[ 20s ] thds: 16 tps: 365.01 qps: 6575.13 (r/w/o: 5118.10/1455.03/2.00) lat (ms,95%): 54.83 err/s: 0.00 reconn/s: 0.00\r\n[ 21s ] thds: 16 tps: 357.98 qps: 6400.59 (r/w/o: 4974.68/1425.91/0.00) lat (ms,95%): 61.08 err/s: 0.00 reconn/s: 0.00\r\n[ 22s ] thds: 16 tps: 328.01 qps: 5948.22 (r/w/o: 4632.18/1316.05/0.00) lat (ms,95%): 71.83 err/s: 0.00 reconn/s: 0.00\r\n[ 23s ] thds: 16 tps: 337.96 qps: 6018.24 (r/w/o: 4675.41/1342.83/0.00) lat (ms,95%): 70.55 err/s: 0.00 reconn/s: 0.00\r\n[ 24s ] thds: 16 tps: 352.03 qps: 6418.51 (r/w/o: 4997.40/1421.11/0.00) lat (ms,95%): 62.19 err/s: 0.00 reconn/s: 0.00\r\n[ 25s ] thds: 16 tps: 362.97 qps: 6510.54 (r/w/o: 5063.64/1446.90/0.00) lat (ms,95%): 62.19 err/s: 0.00 reconn/s: 0.00\r\n[ 26s ] thds: 16 tps: 338.03 qps: 6131.60 (r/w/o: 4764.47/1366.13/1.00) lat (ms,95%): 65.65 err/s: 1.00 reconn/s: 0.00\r\n[ 27s ] thds: 16 tps: 367.00 qps: 6588.06 (r/w/o: 5133.05/1454.01/1.00) lat (ms,95%): 63.32 err/s: 0.00 reconn/s: 0.00\r\n[ 28s ] thds: 16 tps: 327.00 qps: 5893.07 (r/w/o: 4583.05/1310.01/0.00) lat (ms,95%): 84.47 err/s: 0.00 reconn/s: 0.00\r\n[ 29s ] thds: 16 tps: 325.01 qps: 5818.25 (r/w/o: 4516.20/1301.06/1.00) lat (ms,95%): 78.60 err/s: 1.00 reconn/s: 0.00\r\n[ 30s ] thds: 16 tps: 321.98 qps: 5841.56 (r/w/o: 4555.66/1285.90/0.00) lat (ms,95%): 75.82 err/s: 0.00 reconn/s: 0.00\r\nSQL statistics:\r\n    queries performed:\r\n        read:                            100352\r\n        write:                           28659\r\n        other:                           10\r\n        total:                           129021\r\n    transactions:                        7165   (238.42 per sec.)\r\n    queries:                             129021 (4293.32 per sec.)\r\n    ignored errors:                      3      (0.10 per sec.)\r\n    reconnects:                          0      (0.00 per sec.)\r\n\r\nThroughput:\r\n    events/s (eps):                      238.4235\r\n    time elapsed:                        30.0516s\r\n    total number of events:              7165\r\n\r\nLatency (ms):\r\n         min:                                   26.00\r\n         avg:                                   67.06\r\n         max:                                 8868.70\r\n         95th percentile:                       69.29\r\n         sum:                               480498.49\r\n\r\nThreads fairness:\r\n    events (avg/stddev):           447.8125/7.90\r\n    execution time (avg/stddev):   30.0312/0.01\r\n```\r\nIn the above output you can see that the failover took around 9 seconds, and there was no reconnects (sysbench was never disconnected).\r\n\r\n\r\n## Using sysbench with transactions and performing a graceful switchover\r\n\r\nStarting point:\r\n```\r\nmysql> SELECT hostgroup_id, hostname, port, status FROM mysql_servers;                                                                                            +--------------+-----------+-------+--------------+\r\n| hostgroup_id | hostname  | port  | status       |\r\n+--------------+-----------+-------+--------------+\r\n| 1            | 127.0.0.1 | 17822 | ONLINE       |\r\n| 1            | 127.0.0.1 | 17823 | OFFLINE_SOFT |\r\n+--------------+-----------+-------+--------------+\r\n2 rows in set (0,00 sec)\r\n```\r\n\r\nRunning sysbench:\r\n```\r\n../sysbench oltp_read_write.lua --threads=16 --report-interval=1 --max-requests=0 \\\r\n--time=30 --mysql-host=127.0.0.1 --mysql-user=sbtest --mysql-password=sbtest \\\r\n--table-size=1000000 --db-ps-mode=disable --mysql-ignore-errors=1062 \\\r\n--skip-trx=off --mysql-port=6033 run\r\n```\r\n\r\nPerforming the graceful switchover in 3 steps (it can be done in 2 steps combining the last 2, but I want to show the overall reliability of the system).\r\nStep1: current writer is set `OFFLINE_SOFT`:\r\n```\r\nmysql> UPDATE mysql_servers SET status='OFFLINE_SOFT' WHERE port=17822; SELECT hostgroup_id, hostname, port, status FROM mysql_servers; LOAD MYSQL SERVERS TO RUNTIME;\r\nQuery OK, 1 row affected (0,00 sec)\r\n\r\n+--------------+-----------+-------+--------------+\r\n| hostgroup_id | hostname  | port  | status       |\r\n+--------------+-----------+-------+--------------+\r\n| 1            | 127.0.0.1 | 17822 | OFFLINE_SOFT |\r\n| 1            | 127.0.0.1 | 17823 | OFFLINE_SOFT |\r\n+--------------+-----------+-------+--------------+\r\n2 rows in set (0,00 sec)\r\n```\r\nAfter few seconds, step 2: current master is set `OFFLINE_HARD`:\r\n```\r\nmysql> UPDATE mysql_servers SET status='OFFLINE_HARD' WHERE port=17822; SELECT hostgroup_id, hostname, port, status FROM mysql_servers; LOAD MYSQL SERVERS TO RUNTIME;\r\nQuery OK, 1 row affected (0,00 sec)\r\n\r\n+--------------+-----------+-------+--------------+\r\n| hostgroup_id | hostname  | port  | status       |\r\n+--------------+-----------+-------+--------------+\r\n| 1            | 127.0.0.1 | 17822 | OFFLINE_HARD |\r\n| 1            | 127.0.0.1 | 17823 | OFFLINE_SOFT |\r\n+--------------+-----------+-------+--------------+\r\n2 rows in set (0,00 sec)\r\n```\r\nAfter few more seconds, step 3: new master is set `ONLINE`:\r\n```\r\nmysql> UPDATE mysql_servers SET status='ONLINE' WHERE port=17823; SELECT hostgroup_id, hostname, port, status FROM mysql_servers; LOAD MYSQL SERVERS TO RUNTIME; Query OK, 1 row affected (0,00 sec)\r\n\r\n+--------------+-----------+-------+--------------+\r\n| hostgroup_id | hostname  | port  | status       |\r\n+--------------+-----------+-------+--------------+\r\n| 1            | 127.0.0.1 | 17822 | OFFLINE_HARD |\r\n| 1            | 127.0.0.1 | 17823 | ONLINE       |\r\n+--------------+-----------+-------+--------------+\r\n2 rows in set (0,00 sec)\r\n\r\nQuery OK, 0 rows affected (0,01 sec)\r\n```\r\n\r\nComplete output of sysbench:\r\n```\r\n../sysbench oltp_read_write.lua --threads=16 --report-interval=1 --max-requests=0 --time=30 --mysql-host=127.0.0.1 --mysql-user=sbtest --mysql-password=sbtest --table-size=1000000 --db-ps-mode=disable --mysql-ignore-errors=1062 --skip-trx=off --mysql-port=6033 run\r\nsysbench 1.1.0-81ae246 (using bundled LuaJIT 2.1.0-beta3)\r\n\r\nRunning the test with following options:\r\nNumber of threads: 16\r\nReport intermediate results every 1 second(s)\r\nInitializing random number generator from current time\r\n\r\n\r\nInitializing worker threads...\r\n\r\nThreads started!\r\n\r\n[ 1s ] thds: 16 tps: 834.09 qps: 16977.05 (r/w/o: 11899.70/3393.22/1684.14) lat (ms,95%): 30.26 err/s: 0.00 reconn/s: 0.00\r\n[ 2s ] thds: 16 tps: 875.33 qps: 17479.67 (r/w/o: 12240.67/3488.33/1750.67) lat (ms,95%): 29.72 err/s: 0.00 reconn/s: 0.00\r\n[ 3s ] thds: 16 tps: 831.80 qps: 16542.95 (r/w/o: 11569.16/3310.19/1663.59) lat (ms,95%): 31.94 err/s: 0.00 reconn/s: 0.00\r\n[ 4s ] thds: 16 tps: 728.23 qps: 14388.78 (r/w/o: 10062.36/2884.95/1441.48) lat (ms,95%): 36.24 err/s: 0.00 reconn/s: 0.00\r\n[ 5s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 6s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 7s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 8s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 9s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 10s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 11s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 12s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 13s ] thds: 16 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00\r\n[ 14s ] thds: 16 tps: 179.25 qps: 3800.36 (r/w/o: 2672.77/753.06/374.53) lat (ms,95%): 9799.46 err/s: 0.00 reconn/s: 0.00\r\n[ 15s ] thds: 16 tps: 843.04 qps: 16919.76 (r/w/o: 11851.53/3382.15/1686.08) lat (ms,95%): 29.72 err/s: 0.00 reconn/s: 0.00\r\n[ 16s ] thds: 16 tps: 921.01 qps: 18357.27 (r/w/o: 12840.19/3675.05/1842.03) lat (ms,95%): 27.66 err/s: 0.00 reconn/s: 0.00\r\n[ 17s ] thds: 16 tps: 855.82 qps: 17111.39 (r/w/o: 11993.45/3406.30/1711.64) lat (ms,95%): 29.19 err/s: 0.00 reconn/s: 0.00\r\n[ 18s ] thds: 16 tps: 811.97 qps: 16326.59 (r/w/o: 11418.70/3283.94/1623.95) lat (ms,95%): 31.37 err/s: 0.00 reconn/s: 0.00\r\n[ 19s ] thds: 16 tps: 923.90 qps: 18457.03 (r/w/o: 12929.61/3679.62/1847.80) lat (ms,95%): 28.16 err/s: 0.00 reconn/s: 0.00\r\n[ 20s ] thds: 16 tps: 940.91 qps: 18730.21 (r/w/o: 13112.75/3735.64/1881.82) lat (ms,95%): 29.72 err/s: 0.00 reconn/s: 0.00\r\n[ 21s ] thds: 16 tps: 861.08 qps: 17341.66 (r/w/o: 12123.16/3496.33/1722.16) lat (ms,95%): 34.33 err/s: 0.00 reconn/s: 0.00\r\n[ 22s ] thds: 16 tps: 926.79 qps: 18418.91 (r/w/o: 12901.13/3664.19/1853.59) lat (ms,95%): 30.26 err/s: 0.00 reconn/s: 0.00\r\n[ 23s ] thds: 16 tps: 959.45 qps: 19272.16 (r/w/o: 13491.41/3861.84/1918.90) lat (ms,95%): 36.89 err/s: 0.00 reconn/s: 0.00\r\n[ 24s ] thds: 16 tps: 906.03 qps: 18061.63 (r/w/o: 12644.44/3605.13/1812.06) lat (ms,95%): 41.85 err/s: 0.00 reconn/s: 0.00\r\n[ 25s ] thds: 16 tps: 844.87 qps: 16967.29 (r/w/o: 11872.11/3405.46/1689.73) lat (ms,95%): 50.11 err/s: 0.00 reconn/s: 0.00\r\n[ 26s ] thds: 16 tps: 942.12 qps: 18757.35 (r/w/o: 13132.64/3740.47/1884.24) lat (ms,95%): 31.94 err/s: 0.00 reconn/s: 0.00\r\n[ 27s ] thds: 16 tps: 907.81 qps: 18116.17 (r/w/o: 12677.32/3623.23/1815.61) lat (ms,95%): 43.39 err/s: 0.00 reconn/s: 0.00\r\n[ 28s ] thds: 16 tps: 817.76 qps: 16461.25 (r/w/o: 11526.68/3299.05/1635.53) lat (ms,95%): 50.11 err/s: 0.00 reconn/s: 0.00\r\n[ 29s ] thds: 16 tps: 908.51 qps: 18066.94 (r/w/o: 12634.94/3614.99/1817.01) lat (ms,95%): 37.56 err/s: 0.00 reconn/s: 0.00\r\n[ 30s ] thds: 16 tps: 892.89 qps: 18002.86 (r/w/o: 12606.50/3610.57/1785.79) lat (ms,95%): 48.34 err/s: 0.00 reconn/s: 0.00\r\nSQL statistics:\r\n    queries performed:\r\n        read:                            248234\r\n        write:                           70923\r\n        other:                           35463\r\n        total:                           354620\r\n    transactions:                        17731  (590.84 per sec.)\r\n    queries:                             354620 (11816.83 per sec.)\r\n    ignored errors:                      0      (0.00 per sec.)\r\n    reconnects:                          0      (0.00 per sec.)\r\n\r\nThroughput:\r\n    events/s (eps):                      590.8416\r\n    time elapsed:                        30.0097s\r\n    total number of events:              17731\r\n\r\nLatency (ms):\r\n         min:                                    5.19\r\n         avg:                                   27.08\r\n         max:                                 9891.49\r\n         95th percentile:                       33.12\r\n         sum:                               480070.03\r\n\r\nThreads fairness:\r\n    events (avg/stddev):           1108.1875/68.58\r\n    execution time (avg/stddev):   30.0044/0.00\r\n```\r\n\r\nAs you can see now, also in this case we performed a failover in 9 seconds, using transactions, and with absolutely no reconnects because `OFFLINE_SOFT` allows transactions to complete."}}
{"actor":{"display_login":"renecannao"}}