{"action":"created","issue":{"url":"https://api.github.com/repos/zfsonlinux/zfs/issues/4505","repository_url":"https://api.github.com/repos/zfsonlinux/zfs","labels_url":"https://api.github.com/repos/zfsonlinux/zfs/issues/4505/labels{/name}","comments_url":"https://api.github.com/repos/zfsonlinux/zfs/issues/4505/comments","events_url":"https://api.github.com/repos/zfsonlinux/zfs/issues/4505/events","html_url":"https://github.com/zfsonlinux/zfs/issues/4505","id":147383732,"number":4505,"title":"zfs recv Cannot receive incremental stream: dataset is busy","user":{"login":"osd1000","id":9884915,"avatar_url":"https://avatars.githubusercontent.com/u/9884915?v=3","gravatar_id":"","url":"https://api.github.com/users/osd1000","html_url":"https://github.com/osd1000","followers_url":"https://api.github.com/users/osd1000/followers","following_url":"https://api.github.com/users/osd1000/following{/other_user}","gists_url":"https://api.github.com/users/osd1000/gists{/gist_id}","starred_url":"https://api.github.com/users/osd1000/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/osd1000/subscriptions","organizations_url":"https://api.github.com/users/osd1000/orgs","repos_url":"https://api.github.com/users/osd1000/repos","events_url":"https://api.github.com/users/osd1000/events{/privacy}","received_events_url":"https://api.github.com/users/osd1000/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-04-11T10:27:24Z","updated_at":"2016-06-16T13:21:37Z","closed_at":"2016-06-16T13:21:37Z","body":"Kernel 3.13.0-83-generic\r\nzfs version 0.6.5.6-1~trusty\r\n\r\nI've got two largish servers and I'm trying to replicate between them using zfs incremental streams.  It's wrapped up in a script, but the command on the sending side is:\r\n\r\n`zfs send -I local/home/damtp/biophys/xx233@1460216702 local/home/damtp/biophys/xx233@1460367901\r\n`\r\n\r\nand that on the receiving side is:\r\n\r\n`zfs recv -F local/home/damtp/biophys/xx233`\r\n\r\nThe recv returns the error: cannot receive incremental stream: dataset is busy\r\n\r\nOn the sending side `zpool history -i` says:\r\n\r\n```\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460216702 (8496992) tag=.send-141051-1 temp=1 refs=4\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460227501 (8518730) tag=.send-141051-1 temp=1 refs=2\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460238301 (8928273) tag=.send-141051-1 temp=1 refs=2\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460249101 (8955385) tag=.send-141051-1 temp=1 refs=2\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460259901 (8979153) tag=.send-141051-1 temp=1 refs=2\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460270701 (5902777) tag=.send-141051-1 temp=1 refs=2\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460281502 (1733056) tag=.send-141051-1 temp=1 refs=2\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460292301 (8933042) tag=.send-141051-1 temp=1 refs=2\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460295901 (9018720) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460299501 (4333292) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460303102 (2260263) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460306701 (5380797) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460310301 (6961631) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460313901 (7476662) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460317501 (8523857) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460321101 (5852825) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460324701 (6966102) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460328301 (9033624) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460331901 (9040196) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460335501 (6436806) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460339101 (690239) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460342702 (6929537) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460346302 (4336913) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460349901 (4861336) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460353501 (9048037) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460357101 (2777155) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460360701 (1736919) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460364301 (5860186) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:38 [txg:2733968] hold local/home/damtp/biophys/xx233@1460367901 (2263957) tag=.send-141051-1 temp=1 refs=1\r\n2016-04-11.10:53:39 ioctl hold\r\n    input:\r\n        holds:\r\n            local/home/damtp/biophys/xx233@1460216702: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460227501: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460238301: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460249101: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460259901: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460270701: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460281502: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460292301: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460295901: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460299501: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460303102: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460306701: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460310301: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460313901: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460317501: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460321101: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460324701: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460328301: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460331901: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460335501: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460339101: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460342702: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460346302: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460349901: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460353501: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460357101: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460360701: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460364301: '.send-141051-1'\r\n            local/home/damtp/biophys/xx233@1460367901: '.send-141051-1'\r\n        cleanup_fd: 7\r\n\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460216702 (8496992) tag=.send-141051-1 refs=3\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460227501 (8518730) tag=.send-141051-1 refs=1\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460238301 (8928273) tag=.send-141051-1 refs=1\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460249101 (8955385) tag=.send-141051-1 refs=1\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460259901 (8979153) tag=.send-141051-1 refs=1\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460270701 (5902777) tag=.send-141051-1 refs=1\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460281502 (1733056) tag=.send-141051-1 refs=1\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460292301 (8933042) tag=.send-141051-1 refs=1\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460295901 (9018720) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460299501 (4333292) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460303102 (2260263) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460306701 (5380797) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460310301 (6961631) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460313901 (7476662) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460317501 (8523857) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460321101 (5852825) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460324701 (6966102) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460328301 (9033624) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460331901 (9040196) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460335501 (6436806) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460339101 (690239) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460342702 (6929537) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460346302 (4336913) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460349901 (4861336) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460353501 (9048037) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460357101 (2777155) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460360701 (1736919) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460364301 (5860186) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:39 [txg:2733969] release local/home/damtp/biophys/xx233@1460367901 (2263957) tag=.send-141051-1 refs=0\r\n2016-04-11.10:53:44 zfs send -I local/home/damtp/biophys/xx233@1460216702 local/home/damtp/biophys/xx233@1460367901\r\n```\r\n\r\nThe source dataset looks like this:\r\n\r\n```\r\nNAME                                        USED  AVAIL  REFER  MOUNTPOINT\r\nlocal/home/damtp/biophys/xx233              352M  2.66G   341M  /local/home/damtp/biophys/xx233\r\nlocal/home/damtp/biophys/xx233@a            767K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@b               0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@c               0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1            753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1457347973   767K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1457955901   767K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1458395102   753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1458563714   753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1459331101   753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1459770301      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1459773901      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460043901      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460130301      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460205901   753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460216702      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460227501      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460238301      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460249101      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460259901      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460270701      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460281502      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460292301      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460295901      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460299501      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460303102      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460306701      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460310301      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460313901      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460317501      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460321101      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460324701      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460328301      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460331901      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460335501      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460339101      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460342702      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460346302      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460349901      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460353501      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460357101      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460360701      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460364301      0      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460367901      0      -   341M  -\r\n```\r\n\r\nAnd the destination looks like:\r\n\r\n```\r\nNAME                                        USED  AVAIL  REFER  MOUNTPOINT\r\nlocal/home/damtp/biophys/xx233              346M  27.4T   341M  /local/home/damtp/biophys/xx233\r\nlocal/home/damtp/biophys/xx233@1458563714   753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1459331101   753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1459640701   753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1459727101   753K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460043901  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460130301  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460159102  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460169901  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460180701  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460191501  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460202301  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460213101  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460216702  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460223901  14.2K      -   341M  -\r\nlocal/home/damtp/biophys/xx233@1460234701  14.2K      -   341M  -\r\n```\r\n\r\nThe destination pool is mounted ro,noatime."},"comment":{"url":"https://api.github.com/repos/zfsonlinux/zfs/issues/comments/226482894","html_url":"https://github.com/zfsonlinux/zfs/issues/4505#issuecomment-226482894","issue_url":"https://api.github.com/repos/zfsonlinux/zfs/issues/4505","id":226482894,"user":{"login":"kpande","id":5016187,"avatar_url":"https://avatars.githubusercontent.com/u/5016187?v=3","gravatar_id":"","url":"https://api.github.com/users/kpande","html_url":"https://github.com/kpande","followers_url":"https://api.github.com/users/kpande/followers","following_url":"https://api.github.com/users/kpande/following{/other_user}","gists_url":"https://api.github.com/users/kpande/gists{/gist_id}","starred_url":"https://api.github.com/users/kpande/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kpande/subscriptions","organizations_url":"https://api.github.com/users/kpande/orgs","repos_url":"https://api.github.com/users/kpande/repos","events_url":"https://api.github.com/users/kpande/events{/privacy}","received_events_url":"https://api.github.com/users/kpande/received_events","type":"User","site_admin":false},"created_at":"2016-06-16T13:21:37Z","updated_at":"2016-06-16T13:21:37Z","body":"can you try with destination pool unmounted?\r\n\r\nas a side note, this seems better suited for the mailing list (http://list.zfsonlinux.org) and not the issue tracker."}}
{"actor":{"display_login":"kpande"}}