{"action":"created","issue":{"url":"https://api.github.com/repos/digint/btrbk/issues/97","repository_url":"https://api.github.com/repos/digint/btrbk","labels_url":"https://api.github.com/repos/digint/btrbk/issues/97/labels{/name}","comments_url":"https://api.github.com/repos/digint/btrbk/issues/97/comments","events_url":"https://api.github.com/repos/digint/btrbk/issues/97/events","html_url":"https://github.com/digint/btrbk/issues/97","id":169126163,"number":97,"title":"It's normal that gzip raw targets takes a long time ?","user":{"login":"Zardoz89","id":888483,"avatar_url":"https://avatars.githubusercontent.com/u/888483?v=3","gravatar_id":"","url":"https://api.github.com/users/Zardoz89","html_url":"https://github.com/Zardoz89","followers_url":"https://api.github.com/users/Zardoz89/followers","following_url":"https://api.github.com/users/Zardoz89/following{/other_user}","gists_url":"https://api.github.com/users/Zardoz89/gists{/gist_id}","starred_url":"https://api.github.com/users/Zardoz89/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Zardoz89/subscriptions","organizations_url":"https://api.github.com/users/Zardoz89/orgs","repos_url":"https://api.github.com/users/Zardoz89/repos","events_url":"https://api.github.com/users/Zardoz89/events{/privacy}","received_events_url":"https://api.github.com/users/Zardoz89/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/digint/btrbk/labels/question","name":"question","color":"cc317c"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2016-08-03T13:03:19Z","updated_at":"2016-08-09T13:04:57Z","closed_at":null,"body":"I'm just trying btrbk with a server where we have some developer tools (Nexus, Jenkins, GitLab, FishEye), where we need a better robust backup system. Sadly, our backup \"server\" are shared folders of a Windows server via CIFS with DFS, that we have mount with mount.cifs , so we need to use the target raw option.\r\n\r\nI try first with a small subvolume to see if this all works. No problem. However when I try it with the big volume (200GiB), btrbk looks like become freeze executing gzip compression over the output file. I wait like a bit more that an hour. **This is normal that takes too long time ?**  I ended aborting it.\r\n\r\nConfig File : \r\n[btrk.conf.txt](https://github.com/digint/btrbk/files/399494/btrk.conf.txt)\r\n\r\nDryRun output : \r\n```\r\nsudo btrbk -c /etc/btrbk/btrbk.conf -v dryrun\r\nbtrbk command line client, version 0.23.2  (Wed Aug  3 14:59:06 2016)\r\nUsing configuration: /etc/btrbk/btrbk.conf\r\nCreating subvolume snapshot for: /mnt/btrfs_pool/@data\r\n[snapshot] source: /mnt/btrfs_pool/@data\r\n[snapshot] target: /mnt/btrfs_pool/_btrbk_snap/@data.20160803_1\r\nCreating subvolume snapshot for: /mnt/btrfs_pool/@fisheye_data\r\n[snapshot] source: /mnt/btrfs_pool/@fisheye_data\r\n[snapshot] target: /mnt/btrfs_pool/_btrbk_snap/@fisheye_data.20160803_1\r\nCreating subvolume snapshot for: /mnt/btrfs_pool/@opt\r\n[snapshot] source: /mnt/btrfs_pool/@opt\r\n[snapshot] target: /mnt/btrfs_pool/_btrbk_snap/@opt.20160803_1\r\nCreating subvolume snapshot for: /mnt/btrfs_pool/@var\r\n[snapshot] source: /mnt/btrfs_pool/@var\r\n[snapshot] target: /mnt/btrfs_pool/_btrbk_snap/@var.20160803_1\r\nCreating subvolume snapshot for: /mnt/btrfs_pool/@log\r\n[snapshot] source: /mnt/btrfs_pool/@log\r\n[snapshot] target: /mnt/btrfs_pool/_btrbk_snap/@log.20160803_1\r\nCreating subvolume snapshot for: /mnt/btrfs_pool/@backup_etc\r\n[snapshot] source: /mnt/btrfs_pool/@backup_etc\r\n[snapshot] target: /mnt/btrfs_pool/_btrbk_snap/@backup_etc.20160803_1\r\nChecking for missing backups of subvolume \"/mnt/btrfs_pool/@data\" in \"/var/imagenes_dgb/infor/desarrollo03/backups/\"\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@data.20160803\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@data.20160803\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@data.20160803--5b2f8cf1-cf46-8d45-a554-adad5dadf108.btrfs.gz\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@data.20160803_1\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@data.20160803_1\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@data.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000007.btrfs.gz\r\nCreated 2/2 missing backups\r\nChecking for missing backups of subvolume \"/mnt/btrfs_pool/@fisheye_data\" in \"/var/imagenes_dgb/infor/desarrollo03/backups/\"\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@fisheye_data.20160803\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@fisheye_data.20160803\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@fisheye_data.20160803--50ee564c-74b4-684d-9059-33fa0b466085.btrfs.gz\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@fisheye_data.20160803_1\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@fisheye_data.20160803_1\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@fisheye_data.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000008.btrfs.gz\r\nCreated 2/2 missing backups\r\nChecking for missing backups of subvolume \"/mnt/btrfs_pool/@opt\" in \"/var/imagenes_dgb/infor/desarrollo03/backups/\"\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@opt.20160803\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@opt.20160803\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@opt.20160803--bd48bf23-d91e-b843-966c-0fae4f8c749c.btrfs.gz\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@opt.20160803_1\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@opt.20160803_1\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@opt.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000009.btrfs.gz\r\nCreated 2/2 missing backups\r\nChecking for missing backups of subvolume \"/mnt/btrfs_pool/@var\" in \"/var/imagenes_dgb/infor/desarrollo03/backups/\"\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@var.20160803\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@var.20160803\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@var.20160803--43cb72c9-5204-574e-b9e6-d82b7f69ec38.btrfs.gz\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@var.20160803_1\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@var.20160803_1\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@var.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000010.btrfs.gz\r\nCreated 2/2 missing backups\r\nChecking for missing backups of subvolume \"/mnt/btrfs_pool/@log\" in \"/var/imagenes_dgb/infor/desarrollo03/backups/\"\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@log.20160803\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@log.20160803\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@log.20160803--d1a48069-4a65-4f4f-b104-5ce5dec23ed0.btrfs.gz\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@log.20160803_1\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@log.20160803_1\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@log.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000011.btrfs.gz\r\nCreated 2/2 missing backups\r\nChecking for missing backups of subvolume \"/mnt/btrfs_pool/@backup_etc\" in \"/var/imagenes_dgb/infor/desarrollo03/backups/\"\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@backup_etc.20160803\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@backup_etc.20160803\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@backup_etc.20160803--4ef02cfe-44fd-4142-8323-c526c6c26dea.btrfs.gz\r\nCreating subvolume backup (send-receive) for: /mnt/btrfs_pool/_btrbk_snap/@backup_etc.20160803_1\r\nCreating full backup...\r\n[send-to-raw] source: /mnt/btrfs_pool/_btrbk_snap/@backup_etc.20160803_1\r\n[send-to-raw] target: /var/imagenes_dgb/infor/desarrollo03/backups/@backup_etc.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000012.btrfs.gz\r\nCreated 2/2 missing backups\r\nCleaning backups of subvolume \"/mnt/btrfs_pool/@data\": /var/imagenes_dgb/infor/desarrollo03/backups/@data.*\r\nDeleted 0 subvolumes in: /var/imagenes_dgb/infor/desarrollo03/backups/@data.*\r\nCleaning snapshots: /mnt/btrfs_pool/_btrbk_snap/@data.*\r\nDeleted 0 subvolumes in: /mnt/btrfs_pool/_btrbk_snap/@data.*\r\nCleaning backups of subvolume \"/mnt/btrfs_pool/@fisheye_data\": /var/imagenes_dgb/infor/desarrollo03/backups/@fisheye_data.*\r\nDeleted 0 subvolumes in: /var/imagenes_dgb/infor/desarrollo03/backups/@fisheye_data.*\r\nCleaning snapshots: /mnt/btrfs_pool/_btrbk_snap/@fisheye_data.*\r\nDeleted 0 subvolumes in: /mnt/btrfs_pool/_btrbk_snap/@fisheye_data.*\r\nCleaning backups of subvolume \"/mnt/btrfs_pool/@opt\": /var/imagenes_dgb/infor/desarrollo03/backups/@opt.*\r\nDeleted 0 subvolumes in: /var/imagenes_dgb/infor/desarrollo03/backups/@opt.*\r\nCleaning snapshots: /mnt/btrfs_pool/_btrbk_snap/@opt.*\r\nDeleted 0 subvolumes in: /mnt/btrfs_pool/_btrbk_snap/@opt.*\r\nCleaning backups of subvolume \"/mnt/btrfs_pool/@var\": /var/imagenes_dgb/infor/desarrollo03/backups/@var.*\r\nDeleted 0 subvolumes in: /var/imagenes_dgb/infor/desarrollo03/backups/@var.*\r\nCleaning snapshots: /mnt/btrfs_pool/_btrbk_snap/@var.*\r\nDeleted 0 subvolumes in: /mnt/btrfs_pool/_btrbk_snap/@var.*\r\nCleaning backups of subvolume \"/mnt/btrfs_pool/@log\": /var/imagenes_dgb/infor/desarrollo03/backups/@log.*\r\nDeleted 0 subvolumes in: /var/imagenes_dgb/infor/desarrollo03/backups/@log.*\r\nCleaning snapshots: /mnt/btrfs_pool/_btrbk_snap/@log.*\r\nDeleted 0 subvolumes in: /mnt/btrfs_pool/_btrbk_snap/@log.*\r\nCleaning backups of subvolume \"/mnt/btrfs_pool/@backup_etc\": /var/imagenes_dgb/infor/desarrollo03/backups/@backup_etc.*\r\nDeleted 0 subvolumes in: /var/imagenes_dgb/infor/desarrollo03/backups/@backup_etc.*\r\nCleaning snapshots: /mnt/btrfs_pool/_btrbk_snap/@backup_etc.*\r\nDeleted 0 subvolumes in: /mnt/btrfs_pool/_btrbk_snap/@backup_etc.*\r\nCompleted within: 0s  (Wed Aug  3 14:59:06 2016)\r\n--------------------------------------------------------------------------------\r\nBackup Summary (btrbk command line client, version 0.23.2)\r\n\r\n    Date:   Wed Aug  3 14:59:06 2016\r\n    Config: /etc/btrbk/btrbk.conf\r\n    Dryrun: YES\r\n\r\nLegend:\r\n    ===  up-to-date subvolume (source snapshot)\r\n    +++  created subvolume (source snapshot)\r\n    ---  deleted subvolume\r\n    ***  received subvolume (non-incremental)\r\n    >>>  received subvolume (incremental)\r\n--------------------------------------------------------------------------------\r\n/mnt/btrfs_pool/@data\r\n+++ /mnt/btrfs_pool/_btrbk_snap/@data.20160803_1\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@data.20160803--5b2f8cf1-cf46-8d45-a554-adad5dadf108.btrfs.gz\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@data.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000007.btrfs.gz\r\n\r\n/mnt/btrfs_pool/@fisheye_data\r\n+++ /mnt/btrfs_pool/_btrbk_snap/@fisheye_data.20160803_1\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@fisheye_data.20160803--50ee564c-74b4-684d-9059-33fa0b466085.btrfs.gz\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@fisheye_data.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000008.btrfs.gz\r\n\r\n/mnt/btrfs_pool/@opt\r\n+++ /mnt/btrfs_pool/_btrbk_snap/@opt.20160803_1\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@opt.20160803--bd48bf23-d91e-b843-966c-0fae4f8c749c.btrfs.gz\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@opt.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000009.btrfs.gz\r\n\r\n/mnt/btrfs_pool/@var\r\n+++ /mnt/btrfs_pool/_btrbk_snap/@var.20160803_1\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@var.20160803--43cb72c9-5204-574e-b9e6-d82b7f69ec38.btrfs.gz\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@var.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000010.btrfs.gz\r\n\r\n/mnt/btrfs_pool/@log\r\n+++ /mnt/btrfs_pool/_btrbk_snap/@log.20160803_1\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@log.20160803--d1a48069-4a65-4f4f-b104-5ce5dec23ed0.btrfs.gz\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@log.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000011.btrfs.gz\r\n\r\n/mnt/btrfs_pool/@backup_etc\r\n+++ /mnt/btrfs_pool/_btrbk_snap/@backup_etc.20160803_1\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@backup_etc.20160803--4ef02cfe-44fd-4142-8323-c526c6c26dea.btrfs.gz\r\n*** /var/imagenes_dgb/infor/desarrollo03/backups/@backup_etc.20160803_1--XXXXXXXX-XXXX-XXXX-XXXX-000000000012.btrfs.gz\r\n\r\nNOTE: Dryrun was active, none of the operations above were actually executed!\r\n```\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/digint/btrbk/issues/comments/238546062","html_url":"https://github.com/digint/btrbk/issues/97#issuecomment-238546062","issue_url":"https://api.github.com/repos/digint/btrbk/issues/97","id":238546062,"user":{"login":"digint","id":7590973,"avatar_url":"https://avatars.githubusercontent.com/u/7590973?v=3","gravatar_id":"","url":"https://api.github.com/users/digint","html_url":"https://github.com/digint","followers_url":"https://api.github.com/users/digint/followers","following_url":"https://api.github.com/users/digint/following{/other_user}","gists_url":"https://api.github.com/users/digint/gists{/gist_id}","starred_url":"https://api.github.com/users/digint/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/digint/subscriptions","organizations_url":"https://api.github.com/users/digint/orgs","repos_url":"https://api.github.com/users/digint/repos","events_url":"https://api.github.com/users/digint/events{/privacy}","received_events_url":"https://api.github.com/users/digint/received_events","type":"User","site_admin":false},"created_at":"2016-08-09T13:04:57Z","updated_at":"2016-08-09T13:04:57Z","body":"If you're replacing `/var`, it's obvious that you have to restart all the services which access files there.\r\n\r\nInstead of mounting a subvolume to `/var`, you could also have `/var` be a (nested) subvolume, then you could simply move it away and replace it by a backup without remounting. But the problem remains, in order to make sure that your running services close their already opened files and use the new folder (=subvolume in this case), you'll have to restart them."}}
{"actor":{"display_login":"digint"}}