{"action":"created","issue":{"url":"https://api.github.com/repos/ncw/rclone/issues/415","repository_url":"https://api.github.com/repos/ncw/rclone","labels_url":"https://api.github.com/repos/ncw/rclone/issues/415/labels{/name}","comments_url":"https://api.github.com/repos/ncw/rclone/issues/415/comments","events_url":"https://api.github.com/repos/ncw/rclone/issues/415/events","html_url":"https://github.com/ncw/rclone/issues/415","id":145186539,"number":415,"title":"S3 to S3 copy ends up with TotalPartsExceeded","user":{"login":"dkorunic","id":3041939,"avatar_url":"https://avatars.githubusercontent.com/u/3041939?v=3","gravatar_id":"","url":"https://api.github.com/users/dkorunic","html_url":"https://github.com/dkorunic","followers_url":"https://api.github.com/users/dkorunic/followers","following_url":"https://api.github.com/users/dkorunic/following{/other_user}","gists_url":"https://api.github.com/users/dkorunic/gists{/gist_id}","starred_url":"https://api.github.com/users/dkorunic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dkorunic/subscriptions","organizations_url":"https://api.github.com/users/dkorunic/orgs","repos_url":"https://api.github.com/users/dkorunic/repos","events_url":"https://api.github.com/users/dkorunic/events{/privacy}","received_events_url":"https://api.github.com/users/dkorunic/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/ncw/rclone/labels/bug","name":"bug","color":"fc2929"},{"url":"https://api.github.com/repos/ncw/rclone/labels/Remote:%20S3","name":"Remote: S3","color":"fbca04"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/ncw/rclone/milestones/14","html_url":"https://github.com/ncw/rclone/milestones/v1.29","labels_url":"https://api.github.com/repos/ncw/rclone/milestones/14/labels","id":1614565,"number":14,"title":"v1.29","description":"","creator":{"login":"ncw","id":536803,"avatar_url":"https://avatars.githubusercontent.com/u/536803?v=3","gravatar_id":"","url":"https://api.github.com/users/ncw","html_url":"https://github.com/ncw","followers_url":"https://api.github.com/users/ncw/followers","following_url":"https://api.github.com/users/ncw/following{/other_user}","gists_url":"https://api.github.com/users/ncw/gists{/gist_id}","starred_url":"https://api.github.com/users/ncw/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ncw/subscriptions","organizations_url":"https://api.github.com/users/ncw/orgs","repos_url":"https://api.github.com/users/ncw/repos","events_url":"https://api.github.com/users/ncw/events{/privacy}","received_events_url":"https://api.github.com/users/ncw/received_events","type":"User","site_admin":false},"open_issues":4,"closed_issues":13,"state":"open","created_at":"2016-03-01T10:00:22Z","updated_at":"2016-04-07T12:13:58Z","due_on":null,"closed_at":null},"comments":19,"created_at":"2016-04-01T13:53:06Z","updated_at":"2016-04-07T12:21:38Z","closed_at":null,"body":"Hi,\r\n\r\nWe're doing a S3 to S3 copy with rclone and we have 2.6 GB files ending up with TotalPartsExceeded error:\r\n\r\n2016/04/01 15:48:02 D156748_1.mp4: Failed to copy: MultipartUpload: upload multipart failed\r\n        upload id: 2~dxDK4rkYSz7eIt40U_wqcoz6xh4oCZL\r\ncaused by: TotalPartsExceeded: exceeded total allowed configured MaxUploadParts (10000). Adjust PartSize to fit in this limit\r\n\r\nBoth S3 storage backends are Ceph/RadosGW, if that helps. Rclone being used is v1.28 (tried -v1.28-8-ga1323ebβ and v1.28-9-g9dccf91β, neither seem capable of finishing larger uploads).\r\n\r\nCommand being used is simple rclone copy s3_old:bucket s3_new:bucket. Let me know if you need full rclone -v output.\r\n"},"comment":{"url":"https://api.github.com/repos/ncw/rclone/issues/comments/206850383","html_url":"https://github.com/ncw/rclone/issues/415#issuecomment-206850383","issue_url":"https://api.github.com/repos/ncw/rclone/issues/415","id":206850383,"user":{"login":"dkorunic","id":3041939,"avatar_url":"https://avatars.githubusercontent.com/u/3041939?v=3","gravatar_id":"","url":"https://api.github.com/users/dkorunic","html_url":"https://github.com/dkorunic","followers_url":"https://api.github.com/users/dkorunic/followers","following_url":"https://api.github.com/users/dkorunic/following{/other_user}","gists_url":"https://api.github.com/users/dkorunic/gists{/gist_id}","starred_url":"https://api.github.com/users/dkorunic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dkorunic/subscriptions","organizations_url":"https://api.github.com/users/dkorunic/orgs","repos_url":"https://api.github.com/users/dkorunic/repos","events_url":"https://api.github.com/users/dkorunic/events{/privacy}","received_events_url":"https://api.github.com/users/dkorunic/received_events","type":"User","site_admin":false},"created_at":"2016-04-07T12:21:38Z","updated_at":"2016-04-07T12:21:38Z","body":"Awesome work, thanks a lot!"}}