{"action":"closed","issue":{"url":"https://api.github.com/repos/ncw/rclone/issues/2390","repository_url":"https://api.github.com/repos/ncw/rclone","labels_url":"https://api.github.com/repos/ncw/rclone/issues/2390/labels{/name}","comments_url":"https://api.github.com/repos/ncw/rclone/issues/2390/comments","events_url":"https://api.github.com/repos/ncw/rclone/issues/2390/events","html_url":"https://github.com/ncw/rclone/issues/2390","id":340214619,"node_id":"MDU6SXNzdWUzNDAyMTQ2MTk=","number":2390,"title":"Problem: Azure listChunkSize is not configurable","user":{"login":"scollazo","id":2728070,"node_id":"MDQ6VXNlcjI3MjgwNzA=","avatar_url":"https://avatars0.githubusercontent.com/u/2728070?v=4","gravatar_id":"","url":"https://api.github.com/users/scollazo","html_url":"https://github.com/scollazo","followers_url":"https://api.github.com/users/scollazo/followers","following_url":"https://api.github.com/users/scollazo/following{/other_user}","gists_url":"https://api.github.com/users/scollazo/gists{/gist_id}","starred_url":"https://api.github.com/users/scollazo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/scollazo/subscriptions","organizations_url":"https://api.github.com/users/scollazo/orgs","repos_url":"https://api.github.com/users/scollazo/repos","events_url":"https://api.github.com/users/scollazo/events{/privacy}","received_events_url":"https://api.github.com/users/scollazo/received_events","type":"User","site_admin":false},"labels":[{"id":1043114791,"node_id":"MDU6TGFiZWwxMDQzMTE0Nzkx","url":"https://api.github.com/repos/ncw/rclone/labels/Remote:%20Azure%20Blob","name":"Remote: Azure Blob","color":"fbca04","default":false},{"id":86399005,"node_id":"MDU6TGFiZWw4NjM5OTAwNQ==","url":"https://api.github.com/repos/ncw/rclone/labels/bug","name":"bug","color":"fc2929","default":true}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/ncw/rclone/milestones/31","html_url":"https://github.com/ncw/rclone/milestone/31","labels_url":"https://api.github.com/repos/ncw/rclone/milestones/31/labels","id":3430251,"node_id":"MDk6TWlsZXN0b25lMzQzMDI1MQ==","number":31,"title":"v1.44","description":"","creator":{"login":"ncw","id":536803,"node_id":"MDQ6VXNlcjUzNjgwMw==","avatar_url":"https://avatars2.githubusercontent.com/u/536803?v=4","gravatar_id":"","url":"https://api.github.com/users/ncw","html_url":"https://github.com/ncw","followers_url":"https://api.github.com/users/ncw/followers","following_url":"https://api.github.com/users/ncw/following{/other_user}","gists_url":"https://api.github.com/users/ncw/gists{/gist_id}","starred_url":"https://api.github.com/users/ncw/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ncw/subscriptions","organizations_url":"https://api.github.com/users/ncw/orgs","repos_url":"https://api.github.com/users/ncw/repos","events_url":"https://api.github.com/users/ncw/events{/privacy}","received_events_url":"https://api.github.com/users/ncw/received_events","type":"User","site_admin":false},"open_issues":39,"closed_issues":10,"state":"open","created_at":"2018-06-17T16:06:43Z","updated_at":"2018-09-10T19:45:07Z","due_on":"2018-10-13T07:00:00Z","closed_at":null},"comments":11,"created_at":"2018-07-11T12:10:50Z","updated_at":"2018-09-10T19:45:06Z","closed_at":"2018-09-10T19:45:06Z","author_association":"NONE","body":"<!--\r\n\r\nHi!\r\n\r\nWe understand you are having a problem with rclone or have an idea for an improvement - we want to help you with that!\r\n\r\nIf you've just got a question or aren't sure if you've found a bug then please use the rclone forum\r\n\r\n    https://forum.rclone.org/\r\n\r\ninstead of filing an issue.  We'll reply quickly and it won't increase our massive issue backlog.\r\n\r\nIf you think you might have found a bug, please can you try to replicate it with the latest beta?\r\n\r\n    https://beta.rclone.org/\r\n    \r\nIf you can still replicate it with the latest beta, then please fill in the info below which makes our lives much easier.  A log with -vv will make our day :-)\r\n\r\nIf you have an idea for an improvement, then please search the old issues first and if you don't find your idea, make a new issue.\r\n\r\nThanks\r\n\r\nThe Rclone Developers\r\n\r\n-->\r\n\r\n#### What is the problem you are having with rclone?\r\n\r\nIn one of my instances, Rclone fails to list the cointainer files when using --fast-list.\r\n\r\nI was able to work around this by changing the default value for [listChunkSize](https://github.com/ncw/rclone/blob/master/backend/azureblob/azureblob.go#L39) from 5000 to 1000 (tried 2500, but also failed in this host) and rebuilding rclone.\r\n\r\nIt would be nice to have this as a command line option.\r\n\r\n#### What is your rclone version (eg output from `rclone -V`)\r\n\r\nrclone v1.42\r\n- os/arch: linux/amd64\r\n- go version: go1.10.1\r\n\r\n#### Which OS you are using and how many bits (eg Windows 7, 64 bit)\r\n\r\nUbuntu 16.04 64 bits\r\n\r\n####  Which cloud storage system are you using? (eg Google Drive)\r\n\r\nAzure\r\n\r\n#### The command you were trying to run (eg `rclone copy /tmp remote:tmp`)\r\n\r\n```\r\nrclone sync -v --fast-list /path-to-folder azure-rclone:container --backup-dir azure-rclone:container-changes/$(date +%Y)/$(date +%m)/$(date +%d)-$(date +%H%M%S)\r\n```\r\n\r\n\r\n#### A log from the command with the `-vv` flag (eg output from `rclone -vv copy /tmp remote:tmp`)\r\n\r\n```\r\n018/07/06 05:49:52 DEBUG : rclone: Version \"v1.42\" starting with par\r\nameters [\"rclone\" \"sync\" \"-vv\" \"--fast-list\" \"/path-to-upload\" \"azure-rclone:container\" \"--backup-dir\"  \"azure-rclone:container-changes/2018/07/06-054952\"]\r\n2018/07/06 05:49:52 DEBUG : Using config file from \"/root/.config/rclone/rclone.conf\"\r\n2018/07/06 05:50:27 DEBUG : pacer: Rate limited, increasing sleep to 20ms\r\n2018/07/06 05:50:27 DEBUG : pacer: low level retry 1/10 (error read tcp XX.XX.XX.XX:49490 >XX.XX.XX.XX:443: read: connection reset by peer)\r\n2018/07/06 05:50:52 INFO  : \r\nTransferred:      0 Bytes (0 Bytes/s)\r\nErrors:                 0\r\nChecks:                 0\r\nTransferred:            0\r\nElapsed time:      1m0.4s\r\n\r\n2018/07/06 05:51:03 DEBUG : pacer: Rate limited, increasing sleep to 40ms\r\n2018/07/06 05:51:03 DEBUG : pacer: low level retry 2/10 (error read tcp XX.XX.XX.XX:49510->XX.XX.XX.XX:443: read: connection reset by peer)\r\n2018/07/06 05:51:34 DEBUG : pacer: Rate limited, increasing sleep to 80ms\r\n2018/07/06 05:51:34 DEBUG : pacer: low level retry 3/10 (error read tcp XX.XX.XX.XX:49550->XX.XX.XX.XX:443: read: connection reset by peer)\r\n2018/07/06 05:51:52 INFO  : \r\nTransferred:      0 Bytes (0 Bytes/s)\r\nErrors:                 0\r\nChecks:                 0\r\nTransferred:            0\r\nElapsed time:      2m0.4s\r\n\r\n```\r\n\r\n\r\nRetries continue until 10.\r\n"}}
{"actor":{"display_login":"ncw"}}