{"action":"created","issue":{"url":"https://api.github.com/repos/whitepages/solrcloud_manager/issues/4","repository_url":"https://api.github.com/repos/whitepages/solrcloud_manager","labels_url":"https://api.github.com/repos/whitepages/solrcloud_manager/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/whitepages/solrcloud_manager/issues/4/comments","events_url":"https://api.github.com/repos/whitepages/solrcloud_manager/issues/4/events","html_url":"https://github.com/whitepages/solrcloud_manager/issues/4","id":163226859,"number":4,"title":"Collection Backup does not finish","user":{"login":"ko-christ","id":8298918,"avatar_url":"https://avatars.githubusercontent.com/u/8298918?v=3","gravatar_id":"","url":"https://api.github.com/users/ko-christ","html_url":"https://github.com/ko-christ","followers_url":"https://api.github.com/users/ko-christ/followers","following_url":"https://api.github.com/users/ko-christ/following{/other_user}","gists_url":"https://api.github.com/users/ko-christ/gists{/gist_id}","starred_url":"https://api.github.com/users/ko-christ/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ko-christ/subscriptions","organizations_url":"https://api.github.com/users/ko-christ/orgs","repos_url":"https://api.github.com/users/ko-christ/repos","events_url":"https://api.github.com/users/ko-christ/events{/privacy}","received_events_url":"https://api.github.com/users/ko-christ/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-06-30T17:58:53Z","updated_at":"2016-07-01T17:35:11Z","closed_at":"2016-07-01T17:20:44Z","body":"\r\n\r\n\r\n\r\nHi,\r\n\r\nA collection Backup does not seem to finish on some nodes unless running `backupindex` with `--parallel` argument.\r\n\r\n```\r\n  --parallel        Don't wait to confirm each replica backup succeeds. Default: false\r\n```\r\n\r\nSample Output\r\n```\r\njava -jar ~/solrcloud_manager-assembly-latest.jar backupindex -c collection_201606220638 --dir /opt/backups/dev_20160630-12345 -z deb21:2178,deb22:2178,deb23:2178/dev\r\n\r\n...\r\n\r\nWaiting for backup request of col_201606220638_shard1_replica1 to complete\r\nWaiting for backup request of col_201606220638_shard1_replica1 to complete\r\nWaiting for backup request of col_201606220638_shard1_replica1 to complete\r\nWaiting for backup request of col_201606220638_shard1_replica1 to complete\r\n\r\n\r\n#debug\r\nREQUEST: /collection_201606220638_shard1_replica1/replication command=backup&location=/opt/backups/dev_dev_20160630-12345/collection_201606220638/shard1&numberToKeep=2\r\nRESPONSE: GenericSolrResponse({responseHeader={status=0,QTime=8},status=OK})\r\nREQUEST: /collection_201606220638_shard1_replica1/replication command=details\r\nRESPONSE: GenericSolrResponse({responseHeader={status=0,QTime=3},details={indexSize=9.26 KB,indexPath=/opt/solr/index/dev/collection_201606220638/restore.20160630064126164,commits=[{indexVersion=1467210833288,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_Lucene50_0.doc, _0_Lucene50_0.pos, _0_Lucene50_0.tim, _0_Lucene50_0.tip, _0_Lucene54_0.dvd, _0_Lucene54_0.dvm, segments_2]}],isMaster=true,isSlave=false,indexVersion=1467210833288,generation=2,master={replicateAfter=[commit],replicationEnabled=true,replicableVersion=1467210833288,replicableGeneration=2},slave={masterDetails={indexSize=9.26 KB,indexPath=/opt/solr/index/dev/collection_201606220638/restore.20160630064133869,commits=[{indexVersion=1467210833288,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_Lucene50_0.doc, _0_Lucene50_0.pos, _0_Lucene50_0.tim, _0_Lucene50_0.tip, _0_Lucene54_0.dvd, _0_Lucene54_0.dvm, segments_2]}],isMaster=true,isSlave=false,indexVersion=1467210833288,generation=2,master={replicateAfter=[commit],replicationEnabled=true},slave={masterUrl=http://deb21:7637/solr-search/collection_201606220638_shard1_replica1/,indexReplicatedAt=Thu Jun 30 06:02:59 PDT 2016,indexReplicatedAtList=[Thu Jun 30 06:02:59 PDT 2016],timesIndexReplicated=1,lastCycleBytesDownloaded=9648,previousCycleTimeInSeconds=0,currentDate=Thu Jun 30 10:44:56 PDT 2016,isPollingDisabled=false,isReplicating=false}},masterUrl=http://deb23:7637/solr-search/collection_201606220638_shard1_replica3/,indexReplicatedAt=Thu Jun 30 05:54:11 PDT 2016,indexReplicatedAtList=[Thu Jun 30 05:54:11 PDT 2016],timesIndexReplicated=1,lastCycleBytesDownloaded=9648,previousCycleTimeInSeconds=0,currentDate=Thu Jun 30 10:44:54 PDT 2016,isPollingDisabled=false,isReplicating=false},backup={startTime=Thu Jun 30 10:44:54 PDT 2016,fileCount=13,status=success,snapshotCompletedAt=Thu Jun 30 10:44:54 PDT 2016,snapshotName=null}}})\r\nWaiting for backup request of collection_201606220638_shard1_replica1 to complete\r\nREQUEST: /collection_201606220638_shard1_replica1/replication command=details\r\nRESPONSE: GenericSolrResponse({responseHeader={status=0,QTime=3},details={indexSize=9.26 KB,indexPath=/opt/solr/index/dev/collection_201606220638/restore.20160630064126164,commits=[{indexVersion=1467210833288,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_Lucene50_0.doc, _0_Lucene50_0.pos, _0_Lucene50_0.tim, _0_Lucene50_0.tip, _0_Lucene54_0.dvd, _0_Lucene54_0.dvm, segments_2]}],isMaster=true,isSlave=false,indexVersion=1467210833288,generation=2,master={replicateAfter=[commit],replicationEnabled=true,replicableVersion=1467210833288,replicableGeneration=2},slave={masterDetails={indexSize=9.26 KB,indexPath=/opt/solr/index/dev/collection_201606220638/restore.20160630064133869,commits=[{indexVersion=1467210833288,generation=2,filelist=[_0.fdt, _0.fdx, _0.fnm, _0.nvd, _0.nvm, _0.si, _0_Lucene50_0.doc, _0_Lucene50_0.pos, _0_Lucene50_0.tim, _0_Lucene50_0.tip, _0_Lucene54_0.dvd, _0_Lucene54_0.dvm, segments_2]}],isMaster=true,isSlave=false,indexVersion=1467210833288,generation=2,master={replicateAfter=[commit],replicationEnabled=true},slave={masterUrl=http://deb21:7637/solr-search/collection_201606220638_shard1_replica1/,indexReplicatedAt=Thu Jun 30 06:02:59 PDT 2016,indexReplicatedAtList=[Thu Jun 30 06:02:59 PDT 2016],timesIndexReplicated=1,lastCycleBytesDownloaded=9648,previousCycleTimeInSeconds=0,currentDate=Thu Jun 30 10:44:59 PDT 2016,isPollingDisabled=false,isReplicating=false}},masterUrl=http://deb23:7637/solr-search/collection_201606220638_shard1_replica3/,indexReplicatedAt=Thu Jun 30 05:54:11 PDT 2016,indexReplicatedAtList=[Thu Jun 30 05:54:11 PDT 2016],timesIndexReplicated=1,lastCycleBytesDownloaded=9648,previousCycleTimeInSeconds=0,currentDate=Thu Jun 30 10:44:57 PDT 2016,isPollingDisabled=false,isReplicating=false},backup={startTime=Thu Jun 30 10:44:54 PDT 2016,fileCount=13,status=success,snapshotCompletedAt=Thu Jun 30 10:44:54 PDT 2016,snapshotName=null}}})\r\nWaiting for backup request of collection_201606220638_shard1_replica1 to complete\r\n...\r\n\r\n\r\n\r\n### solr log\r\n4314707 INFO  (qtp2109957412-159) [c:collection_201606220638 s:shard1 r:deb23:7637_solr-search_collection_201606220638_shard1_replica3 x:collection_201606220638_shard1_replica3] o.a.s.c.S.Request [collection_201606220638_shard1_replica3]  webapp=/solr-search path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0\r\n\r\n```\r\n\r\n\r\nI can see that the index data are written on disk. \r\nWhat exactly prevents the backup from stopping successfully. Is it expecting something specific from the `replication?command=details` page?\r\nAnd last but not least, is using `--parallel` argument and ignoring the backup status confirmation somehow risky and not suggested?\r\n\r\nAny advice is welcome. Thanks!"},"comment":{"url":"https://api.github.com/repos/whitepages/solrcloud_manager/issues/comments/230005244","html_url":"https://github.com/whitepages/solrcloud_manager/issues/4#issuecomment-230005244","issue_url":"https://api.github.com/repos/whitepages/solrcloud_manager/issues/4","id":230005244,"user":{"login":"ko-christ","id":8298918,"avatar_url":"https://avatars.githubusercontent.com/u/8298918?v=3","gravatar_id":"","url":"https://api.github.com/users/ko-christ","html_url":"https://github.com/ko-christ","followers_url":"https://api.github.com/users/ko-christ/followers","following_url":"https://api.github.com/users/ko-christ/following{/other_user}","gists_url":"https://api.github.com/users/ko-christ/gists{/gist_id}","starred_url":"https://api.github.com/users/ko-christ/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ko-christ/subscriptions","organizations_url":"https://api.github.com/users/ko-christ/orgs","repos_url":"https://api.github.com/users/ko-christ/repos","events_url":"https://api.github.com/users/ko-christ/events{/privacy}","received_events_url":"https://api.github.com/users/ko-christ/received_events","type":"User","site_admin":false},"created_at":"2016-07-01T17:35:11Z","updated_at":"2016-07-01T17:35:11Z","body":"I see. Yes [2] and different timezones must be the root cause."}}
{"actor":{"display_login":"ko-christ"}}