{"action":"created","issue":{"url":"https://api.github.com/repos/camlistore/camlistore/issues/681","repository_url":"https://api.github.com/repos/camlistore/camlistore","labels_url":"https://api.github.com/repos/camlistore/camlistore/issues/681/labels{/name}","comments_url":"https://api.github.com/repos/camlistore/camlistore/issues/681/comments","events_url":"https://api.github.com/repos/camlistore/camlistore/issues/681/events","html_url":"https://github.com/camlistore/camlistore/issues/681","id":133123391,"number":681,"title":"blobpacked: packing fails when loose blobs are received out of \"file\" order","user":{"login":"mpl","id":626071,"avatar_url":"https://avatars.githubusercontent.com/u/626071?v=3","gravatar_id":"","url":"https://api.github.com/users/mpl","html_url":"https://github.com/mpl","followers_url":"https://api.github.com/users/mpl/followers","following_url":"https://api.github.com/users/mpl/following{/other_user}","gists_url":"https://api.github.com/users/mpl/gists{/gist_id}","starred_url":"https://api.github.com/users/mpl/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mpl/subscriptions","organizations_url":"https://api.github.com/users/mpl/orgs","repos_url":"https://api.github.com/users/mpl/repos","events_url":"https://api.github.com/users/mpl/events{/privacy}","received_events_url":"https://api.github.com/users/mpl/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-02-12T00:08:33Z","updated_at":"2016-02-12T00:09:42Z","closed_at":null,"body":"When packing a file, if any of the pieces are missing we fail without ever retrying.\r\n\r\nWhen using camtool sync to a destination that has a blobpacked storage, the blobs will be sent to the destination in enumeration order, therefore without any guarantee that the destination will receive all the data blob parts of a file to pack before the file schema blob.\r\nWhen that happens, the destination will try to pack as soon as it receives the file schema blob, and hence will fail because it has not yet received all of the data parts.\r\n\r\nOf course one way around this problem (which only works if the sync source is also a blobpacked) is to manually sync first from/to /bs-packed/, then from/to /bs-loose/. But that is not user-friendly at all.\r\n"},"comment":{"url":"https://api.github.com/repos/camlistore/camlistore/issues/comments/183119771","html_url":"https://github.com/camlistore/camlistore/issues/681#issuecomment-183119771","issue_url":"https://api.github.com/repos/camlistore/camlistore/issues/681","id":183119771,"user":{"login":"mpl","id":626071,"avatar_url":"https://avatars.githubusercontent.com/u/626071?v=3","gravatar_id":"","url":"https://api.github.com/users/mpl","html_url":"https://github.com/mpl","followers_url":"https://api.github.com/users/mpl/followers","following_url":"https://api.github.com/users/mpl/following{/other_user}","gists_url":"https://api.github.com/users/mpl/gists{/gist_id}","starred_url":"https://api.github.com/users/mpl/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mpl/subscriptions","organizations_url":"https://api.github.com/users/mpl/orgs","repos_url":"https://api.github.com/users/mpl/repos","events_url":"https://api.github.com/users/mpl/events{/privacy}","received_events_url":"https://api.github.com/users/mpl/received_events","type":"User","site_admin":false},"created_at":"2016-02-12T00:09:42Z","updated_at":"2016-02-12T00:09:42Z","body":"One possible solution:\r\nhttps://camlistore-review.googlesource.com/6011\r\n"}}