{"action":"closed","issue":{"url":"https://api.github.com/repos/github/gh-ost/issues/336","repository_url":"https://api.github.com/repos/github/gh-ost","labels_url":"https://api.github.com/repos/github/gh-ost/issues/336/labels{/name}","comments_url":"https://api.github.com/repos/github/gh-ost/issues/336/comments","events_url":"https://api.github.com/repos/github/gh-ost/issues/336/events","html_url":"https://github.com/github/gh-ost/issues/336","id":195048301,"number":336,"title":"Gh-ost doesn't actually start copying existing data for some of my bigger tables...","user":{"login":"ConneXNL","id":971199,"avatar_url":"https://avatars.githubusercontent.com/u/971199?v=3","gravatar_id":"","url":"https://api.github.com/users/ConneXNL","html_url":"https://github.com/ConneXNL","followers_url":"https://api.github.com/users/ConneXNL/followers","following_url":"https://api.github.com/users/ConneXNL/following{/other_user}","gists_url":"https://api.github.com/users/ConneXNL/gists{/gist_id}","starred_url":"https://api.github.com/users/ConneXNL/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ConneXNL/subscriptions","organizations_url":"https://api.github.com/users/ConneXNL/orgs","repos_url":"https://api.github.com/users/ConneXNL/repos","events_url":"https://api.github.com/users/ConneXNL/events{/privacy}","received_events_url":"https://api.github.com/users/ConneXNL/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-12-12T18:24:22Z","updated_at":"2016-12-13T11:33:49Z","closed_at":"2016-12-13T11:33:49Z","body":"I might be missing something but it looks like gh-ost doesn't actually start for one/two of my larger tables. As you can see in the below log it **does** add the new rows that are being added but it **doesn't** start with copying the existing rows. Other tables in the same database do work. \r\n\r\nHere is the log:\r\n\r\n```\r\n./gh-ost \r\n--max-load=Threads_running=25 \r\n--critical-load=Threads_running=1000 \r\n--chunk-size=1000 \r\n--max-lag-millis=5000 \r\n--user=\"xxxxx\" \r\n--password=\"xxxxxx\" \r\n--host=localhost \r\n--database=\"test_database\" \r\n--table=\"my_test_table\" \r\n--verbose \r\n--alter=\"ADD new_test_column INT DEFAULT NULL\" \r\n--assume-rbr \r\n--allow-master-master \r\n--cut-over=default \r\n--exact-rowcount \r\n--skip-foreign-key-checks \r\n--concurrent-rowcount \r\n--default-retries=120 \r\n--panic-flag-file=/tmp/ghost.panic.flag \r\n--postpone-cut-over-flag-file=/tmp/ghost.postpone.flag \r\n--initially-drop-ghost-table \r\n--approve-renamed-columns \r\n--execute\r\n2016-12-12 10:59:48 INFO starting gh-ost 1.0.30\r\n2016-12-12 10:59:48 INFO Migrating `test_database`.`my_test_table`\r\n2016-12-12 10:59:48 INFO connection validated on localhost:3306\r\n2016-12-12 10:59:48 INFO User has ALL privileges\r\n2016-12-12 10:59:48 INFO binary logs validated on localhost:3306\r\n2016-12-12 10:59:48 INFO Table found. Engine=InnoDB\r\n2016-12-12 10:59:48 WARNING --skip-foreign-key-checks provided: will not check for foreign keys\r\n2016-12-12 10:59:48 INFO Estimated number of rows via EXPLAIN: 48850611\r\n2016-12-12 10:59:48 INFO Recursively searching for replication master\r\n2016-12-12 10:59:49 INFO Master found to be xxx.xxx.xxx.xxx:3306\r\n2016-12-12 10:59:49 INFO log_slave_updates validated on localhost:3306\r\n2016-12-12 10:59:49 INFO connection validated on localhost:3306\r\n2016-12-12 10:59:49 INFO Registering replica at localhost:3306\r\n2016-12-12 10:59:49 INFO Connecting binlog streamer at mysql-bin.000005:70346669\r\n2016-12-12 10:59:49 INFO rotate to next log name: mysql-bin.000005\r\n2016-12-12 10:59:50 INFO connection validated on xxx.xxx.xxx.xxx:3306\r\n2016-12-12 10:59:51 INFO connection validated on xxx.xxx.xxx.xxx:3306\r\n2016-12-12 10:59:51 INFO will use time_zone='SYSTEM' on applier\r\n2016-12-12 10:59:52 INFO Examining table structure on applier\r\n2016-12-12 10:59:52 INFO Droppping table `test_database`.`_test_table_gho`\r\n2016-12-12 10:59:53 INFO Table dropped\r\n2016-12-12 10:59:53 INFO Droppping table `test_database`.`_test_table_ghc`\r\n2016-12-12 10:59:55 INFO Table dropped\r\n2016-12-12 10:59:55 INFO Creating changelog table `test_database`.`_test_table_ghc`\r\n2016-12-12 11:00:02 INFO Changelog table created\r\n2016-12-12 11:00:02 INFO Creating ghost table `test_database`.`_test_table_gho`\r\n2016-12-12 11:00:04 INFO Ghost table created\r\n2016-12-12 11:00:04 INFO Altering ghost table `test_database`.`_test_table_gho`\r\n2016-12-12 11:00:06 INFO Ghost table altered\r\n2016-12-12 11:00:07 INFO Intercepted changelog state GhostTableMigrated\r\n2016-12-12 11:00:08 INFO Waiting for ghost table to be migrated. Current lag is 0s\r\n2016-12-12 11:00:08 INFO Handled changelog state GhostTableMigrated\r\n2016-12-12 11:00:08 INFO Chosen shared unique key is PRIMARY\r\n2016-12-12 11:00:08 INFO Shared columns are id,testa,testb\r\n2016-12-12 11:00:08 INFO Listening on unix socket file: /tmp/gh-ost.test_database.test_table.sock\r\n2016-12-12 11:00:08 INFO As instructed, counting rows in the background; meanwhile I will use an estimated count, and will update it later on\r\n2016-12-12 11:00:08 INFO As instructed, I'm issuing a SELECT COUNT(*) on the table. This may take a while\r\n2016-12-12 11:00:09 INFO Migration min values: [1]\r\n2016-12-12 11:00:09 INFO Migration max values: [52430516]\r\n2016-12-12 11:00:09 INFO Waiting for first throttle metrics to be collected\r\n# Migrating `test_database`.`test_table`; Ghost table is `test_database`.`_test_table_gho`\r\n# Migrating test:3306; inspecting dev:3306; executing on dev\r\n# Migration started at Mon Dec 12 10:59:48 -0600 2016\r\n# chunk-size: 1000; max-lag-millis: 5000ms; max-load: Threads_running=25; critical-load: Threads_running=1000; nice-ratio: 0.000000\r\n# throttle-additional-flag-file: /tmp/gh-ost.throttle\r\n# postpone-cut-over-flag-file: /tmp/ghost.postpone.flag\r\n# panic-flag-file: /tmp/ghost.panic.flag\r\n# Serving on unix socket: /tmp/gh-ost.test_database.test_table.sock\r\nCopy: 0/48850611 0.0%; Applied: 0; Backlog: 2/100; Time: 21s(total), 0s(copy); streamer: mysql-bin.000005:70570811; State: migrating; ETA: N/A\r\nCopy: 0/48850612 0.0%; Applied: 1; Backlog: 8/100; Time: 24s(total), 2s(copy); streamer: mysql-bin.000005:70577047; State: migrating; ETA: N/A\r\nCopy: 0/48850612 0.0%; Applied: 1; Backlog: 8/100; Time: 25s(total), 3s(copy); streamer: mysql-bin.000005:70577942; State: migrating; ETA: N/A\r\nCopy: 0/48850613 0.0%; Applied: 2; Backlog: 11/100; Time: 26s(total), 4s(copy); streamer: mysql-bin.000005:70594153; State: migrating; ETA: N/A\r\n2016-12-12 11:00:15 INFO Exact number of rows via COUNT: 51219858\r\nCopy: 0/51219861 0.0%; Applied: 3; Backlog: 11/100; Time: 27s(total), 5s(copy); streamer: mysql-bin.000005:70614035; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:16 statement.go:27: Invalid Connection\r\nCopy: 0/51219862 0.0%; Applied: 4; Backlog: 11/100; Time: 28s(total), 6s(copy); streamer: mysql-bin.000005:70617621; State: migrating; ETA: N/A\r\nCopy: 0/51219863 0.0%; Applied: 5; Backlog: 13/100; Time: 29s(total), 7s(copy); streamer: mysql-bin.000005:70622913; State: migrating; ETA: N/A\r\nCopy: 0/51219863 0.0%; Applied: 5; Backlog: 13/100; Time: 30s(total), 8s(copy); streamer: mysql-bin.000005:70633264; State: migrating; ETA: N/A\r\nCopy: 0/51219864 0.0%; Applied: 6; Backlog: 12/100; Time: 31s(total), 9s(copy); streamer: mysql-bin.000005:70633264; State: migrating; ETA: N/A\r\nCopy: 0/51219865 0.0%; Applied: 7; Backlog: 28/100; Time: 32s(total), 10s(copy); streamer: mysql-bin.000005:70664696; State: migrating; ETA: N/A\r\nCopy: 0/51219866 0.0%; Applied: 8; Backlog: 27/100; Time: 33s(total), 11s(copy); streamer: mysql-bin.000005:70666533; State: migrating; ETA: N/A\r\nCopy: 0/51219867 0.0%; Applied: 9; Backlog: 29/100; Time: 34s(total), 12s(copy); streamer: mysql-bin.000005:70678030; State: migrating; ETA: N/A\r\nCopy: 0/51219867 0.0%; Applied: 9; Backlog: 30/100; Time: 35s(total), 13s(copy); streamer: mysql-bin.000005:70688094; State: migrating; ETA: N/A\r\nCopy: 0/51219868 0.0%; Applied: 10; Backlog: 35/100; Time: 36s(total), 14s(copy); streamer: mysql-bin.000005:70724991; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:25 statement.go:27: Invalid Connection\r\nCopy: 0/51219869 0.0%; Applied: 11; Backlog: 37/100; Time: 37s(total), 15s(copy); streamer: mysql-bin.000005:70737800; State: migrating; ETA: N/A\r\nCopy: 0/51219870 0.0%; Applied: 12; Backlog: 38/100; Time: 38s(total), 16s(copy); streamer: mysql-bin.000005:70748958; State: migrating; ETA: N/A\r\nCopy: 0/51219871 0.0%; Applied: 13; Backlog: 44/100; Time: 39s(total), 17s(copy); streamer: mysql-bin.000005:70779266; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:28 statement.go:27: Invalid Connection\r\nCopy: 0/51219872 0.0%; Applied: 14; Backlog: 45/100; Time: 40s(total), 18s(copy); streamer: mysql-bin.000005:70781813; State: migrating; ETA: N/A\r\nCopy: 0/51219873 0.0%; Applied: 15; Backlog: 46/100; Time: 41s(total), 19s(copy); streamer: mysql-bin.000005:70784379; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:30 statement.go:27: Invalid Connection\r\nCopy: 0/51219873 0.0%; Applied: 15; Backlog: 47/100; Time: 42s(total), 20s(copy); streamer: mysql-bin.000005:70794563; State: migrating; ETA: N/A\r\nCopy: 0/51219874 0.0%; Applied: 16; Backlog: 49/100; Time: 43s(total), 21s(copy); streamer: mysql-bin.000005:70797293; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:31 statement.go:27: Invalid Connection\r\nCopy: 0/51219875 0.0%; Applied: 17; Backlog: 55/100; Time: 44s(total), 22s(copy); streamer: mysql-bin.000005:70801997; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:34 statement.go:27: Invalid Connection\r\nCopy: 0/51219876 0.0%; Applied: 18; Backlog: 55/100; Time: 45s(total), 23s(copy); streamer: mysql-bin.000005:70804927; State: migrating; ETA: N/A\r\nCopy: 0/51219877 0.0%; Applied: 19; Backlog: 56/100; Time: 46s(total), 24s(copy); streamer: mysql-bin.000005:70807527; State: migrating; ETA: N/A\r\nCopy: 0/51219878 0.0%; Applied: 20; Backlog: 57/100; Time: 47s(total), 25s(copy); streamer: mysql-bin.000005:70817784; State: migrating; ETA: N/A\r\nCopy: 0/51219879 0.0%; Applied: 21; Backlog: 63/100; Time: 48s(total), 26s(copy); streamer: mysql-bin.000005:70823014; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:37 statement.go:27: Invalid Connection\r\nCopy: 0/51219880 0.0%; Applied: 22; Backlog: 63/100; Time: 49s(total), 27s(copy); streamer: mysql-bin.000005:70824581; State: migrating; ETA: N/A\r\nCopy: 0/51219881 0.0%; Applied: 23; Backlog: 68/100; Time: 50s(total), 28s(copy); streamer: mysql-bin.000005:70839052; State: migrating; ETA: N/A\r\nCopy: 0/51219881 0.0%; Applied: 23; Backlog: 70/100; Time: 51s(total), 29s(copy); streamer: mysql-bin.000005:70840673; State: migrating; ETA: N/A\r\nCopy: 0/51219882 0.0%; Applied: 24; Backlog: 70/100; Time: 52s(total), 30s(copy); streamer: mysql-bin.000005:70858605; State: migrating; ETA: N/A\r\nCopy: 0/51219883 0.0%; Applied: 25; Backlog: 75/100; Time: 53s(total), 31s(copy); streamer: mysql-bin.000005:70871566; State: migrating; ETA: N/A\r\nCopy: 0/51219884 0.0%; Applied: 26; Backlog: 78/100; Time: 54s(total), 32s(copy); streamer: mysql-bin.000005:70884145; State: migrating; ETA: N/A\r\nCopy: 0/51219885 0.0%; Applied: 27; Backlog: 79/100; Time: 55s(total), 33s(copy); streamer: mysql-bin.000005:70885375; State: migrating; ETA: N/A\r\nCopy: 0/51219885 0.0%; Applied: 27; Backlog: 80/100; Time: 56s(total), 34s(copy); streamer: mysql-bin.000005:70895182; State: migrating; ETA: N/A\r\nCopy: 0/51219886 0.0%; Applied: 28; Backlog: 81/100; Time: 57s(total), 35s(copy); streamer: mysql-bin.000005:70898980; State: migrating; ETA: N/A\r\nCopy: 0/51219887 0.0%; Applied: 29; Backlog: 84/100; Time: 58s(total), 36s(copy); streamer: mysql-bin.000005:70928196; State: migrating; ETA: N/A\r\nCopy: 0/51219888 0.0%; Applied: 30; Backlog: 84/100; Time: 59s(total), 37s(copy); streamer: mysql-bin.000005:70938221; State: migrating; ETA: N/A\r\nCopy: 0/51219888 0.0%; Applied: 30; Backlog: 84/100; Time: 1m0s(total), 38s(copy); streamer: mysql-bin.000005:70939507; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:52 statement.go:27: Invalid Connection\r\nCopy: 0/51219892 0.0%; Applied: 34; Backlog: 92/100; Time: 1m5s(total), 43s(copy); streamer: mysql-bin.000005:70992619; State: migrating; ETA: N/A\r\nCopy: 0/51219896 0.0%; Applied: 38; Backlog: 100/100; Time: 1m10s(total), 48s(copy); streamer: mysql-bin.000005:71009424; State: throttled, lag=5.120022s; ETA: N/A\r\n[MySQL] 2016/12/12 11:00:59 statement.go:27: Invalid Connection\r\nCopy: 0/51219898 0.0%; Applied: 40; Backlog: 100/100; Time: 1m15s(total), 53s(copy); streamer: mysql-bin.000005:71012086; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:01:05 statement.go:27: Invalid Connection\r\nCopy: 0/51219901 0.0%; Applied: 43; Backlog: 100/100; Time: 1m20s(total), 58s(copy); streamer: mysql-bin.000005:71020162; State: migrating; ETA: N/A\r\n[MySQL] 2016/12/12 11:01:09 statement.go:27: Invalid Connection\r\nCopy: 0/51219905 0.0%; Applied: 47; Backlog: 100/100; Time: 1m25s(total), 1m3s(copy); streamer: mysql-bin.000005:71061832; State: migrating; ETA: N/A\r\n```\r\n\r\n\r\n\r\n\r\n"}}
{"actor":{"display_login":"shlomi-noach"}}