title: Downloading very large number of files from S3
body: <p>I would like to setup a Disaster Recovery copy for an s3 bucket with ~2 million files.</p>
  
  <p>This does not have to be automated since we trust Amazon's promise for high reliability, we have enabled versioning and setup MFA for deleting the bucket itself.</p>
  
  <p>So I just want to periodically download (manually) the contents of the bucket to keep an offline copy.</p>
  
  <p>I have tried a few S3 clients but most of them hang when dealing with such a large folder.</p>
  
  <p>Is there any tool that is right for the job or do we have to resort to Amazon's data export service (where we have to send them a usb drive everytime we need an offline backup).</p>
  
  <p>thanks in advance for your advice!</p>