{"action":"opened","issue":{"url":"https://api.github.com/repos/github/gh-ost/issues/677","repository_url":"https://api.github.com/repos/github/gh-ost","labels_url":"https://api.github.com/repos/github/gh-ost/issues/677/labels{/name}","comments_url":"https://api.github.com/repos/github/gh-ost/issues/677/comments","events_url":"https://api.github.com/repos/github/gh-ost/issues/677/events","html_url":"https://github.com/github/gh-ost/issues/677","id":378892339,"node_id":"MDU6SXNzdWUzNzg4OTIzMzk=","number":677,"title":"Cut over never tables place","user":{"login":"alexisde","id":29050910,"node_id":"MDQ6VXNlcjI5MDUwOTEw","avatar_url":"https://avatars3.githubusercontent.com/u/29050910?v=4","gravatar_id":"","url":"https://api.github.com/users/alexisde","html_url":"https://github.com/alexisde","followers_url":"https://api.github.com/users/alexisde/followers","following_url":"https://api.github.com/users/alexisde/following{/other_user}","gists_url":"https://api.github.com/users/alexisde/gists{/gist_id}","starred_url":"https://api.github.com/users/alexisde/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexisde/subscriptions","organizations_url":"https://api.github.com/users/alexisde/orgs","repos_url":"https://api.github.com/users/alexisde/repos","events_url":"https://api.github.com/users/alexisde/events{/privacy}","received_events_url":"https://api.github.com/users/alexisde/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-11-08T19:56:35Z","updated_at":"2018-11-08T19:56:35Z","closed_at":null,"author_association":"NONE","body":"Hello, I'm trying to execute a migration on a relatively small, but very busy table, I'm bumping into an issue were the cutover never takes place due to a timeout waiting for the lock\r\n\r\nCopy finishes and the wait for the lock starts:\r\n```\r\nCopy: 2808000/2996797 93.7%; Applied: 28; Backlog: 0/1000; Time: 1m53s(total), 29s(copy); streamer: mysql-bin.007308:94713448; State: migrating; ETA: 1s\r\nCopy: 2904000/2996797 96.9%; Applied: 29; Backlog: 0/1000; Time: 1m54s(total), 30s(copy); streamer: mysql-bin.007308:94797840; State: migrating; ETA: 0s\r\nCopy: 3003000/2996797 100.2%; Applied: 32; Backlog: 0/1000; Time: 1m55s(total), 31s(copy); streamer: mysql-bin.007308:95873661; State: migrating; ETA: due\r\nCopy: 3493000/2996797 116.6%; Applied: 34; Backlog: 0/1000; Time: 2m0s(total), 36s(copy); streamer: mysql-bin.007308:97631899; State: migrating; ETA: due\r\nCopy: 3604607/3604607 100.0%; Applied: 34; Backlog: 0/1000; Time: 2m1s(total), 37s(copy); streamer: mysql-bin.007308:97631899; State: migrating; ETA: due\r\n\r\n2018-11-08 11:52:00 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:52:00 ERROR 2018-11-08 11:52:00 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 34; Backlog: 0/1000; Time: 2m5s(total), 37s(copy); streamer: mysql-bin.007308:97712629; State: migrating; ETA: due\r\n2018-11-08 11:52:04 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:52:04 ERROR 2018-11-08 11:52:04 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 34; Backlog: 0/1000; Time: 2m10s(total), 37s(copy); streamer: mysql-bin.007308:98051180; State: migrating; ETA: due\r\n2018-11-08 11:52:08 ERROR Timeout while waiting for events up to lock\r\n```\r\nThen it keeps going until:\r\n```\r\n2018/11/08 11:54:56 binlogsyncer.go:573: [info] rotate to (mysql-bin.007309, 4)\r\n2018/11/08 11:54:56 binlogsyncer.go:573: [info] rotate to (mysql-bin.007309, 4)\r\nCopy: 3604607/3604607 100.0%; Applied: 118; Backlog: 0/1000; Time: 5m0s(total), 37s(copy); streamer: mysql-bin.007309:285593; State: migrating; ETA: due\r\n2018-11-08 11:54:57 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:54:57 ERROR 2018-11-08 11:54:57 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 119; Backlog: 1/1000; Time: 5m5s(total), 37s(copy); streamer: mysql-bin.007309:6345872; State: migrating; ETA: due\r\n2018-11-08 11:55:01 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:01 ERROR 2018-11-08 11:55:01 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:05 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:05 ERROR 2018-11-08 11:55:05 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 121; Backlog: 0/1000; Time: 5m10s(total), 37s(copy); streamer: mysql-bin.007309:11526735; State: migrating; ETA: due\r\n2018-11-08 11:55:09 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:09 ERROR 2018-11-08 11:55:09 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 122; Backlog: 0/1000; Time: 5m15s(total), 37s(copy); streamer: mysql-bin.007309:17217624; State: migrating; ETA: due\r\n2018-11-08 11:55:13 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:13 ERROR 2018-11-08 11:55:13 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 123; Backlog: 0/1000; Time: 5m20s(total), 37s(copy); streamer: mysql-bin.007309:20531502; State: migrating; ETA: due\r\n2018-11-08 11:55:17 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:17 ERROR 2018-11-08 11:55:17 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 123; Backlog: 0/1000; Time: 5m25s(total), 37s(copy); streamer: mysql-bin.007309:20565362; State: migrating; ETA: due\r\n2018-11-08 11:55:21 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:21 ERROR 2018-11-08 11:55:21 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:25 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:25 ERROR 2018-11-08 11:55:25 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 123; Backlog: 0/1000; Time: 5m30s(total), 37s(copy); streamer: mysql-bin.007309:20568775; State: migrating; ETA: due\r\n2018-11-08 11:55:29 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:29 ERROR 2018-11-08 11:55:29 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 123; Backlog: 0/1000; Time: 5m35s(total), 37s(copy); streamer: mysql-bin.007309:23137075; State: migrating; ETA: due\r\n2018-11-08 11:55:34 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:34 ERROR 2018-11-08 11:55:34 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 125; Backlog: 0/1000; Time: 5m40s(total), 37s(copy); streamer: mysql-bin.007309:27078416; State: migrating; ETA: due\r\n2018-11-08 11:55:38 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:38 ERROR 2018-11-08 11:55:38 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 125; Backlog: 0/1000; Time: 5m45s(total), 37s(copy); streamer: mysql-bin.007309:29802951; State: migrating; ETA: due\r\n2018-11-08 11:55:42 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:42 ERROR 2018-11-08 11:55:42 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:46 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:46 ERROR 2018-11-08 11:55:46 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 126; Backlog: 0/1000; Time: 5m50s(total), 37s(copy); streamer: mysql-bin.007309:31690313; State: migrating; ETA: due\r\n2018-11-08 11:55:50 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:50 ERROR 2018-11-08 11:55:50 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 128; Backlog: 3/1000; Time: 5m55s(total), 37s(copy); streamer: mysql-bin.007309:34812065; State: migrating; ETA: due\r\n2018-11-08 11:55:54 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:54 ERROR 2018-11-08 11:55:54 ERROR Timeout while waiting for events up to lock\r\nCopy: 3604607/3604607 100.0%; Applied: 132; Backlog: 1/1000; Time: 6m0s(total), 37s(copy); streamer: mysql-bin.007309:40607736; State: migrating; ETA: due\r\n2018-11-08 11:55:58 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:58 ERROR 2018-11-08 11:55:58 ERROR Timeout while waiting for events up to lock\r\n2018-11-08 11:55:58 FATAL 2018-11-08 11:55:58 ERROR Timeout while waiting for events up to lock\r\n```"}}
{"actor":{"display_login":"alexisde"}}