{"action":"created","issue":{"url":"https://api.github.com/repos/dask/distributed/issues/180","repository_url":"https://api.github.com/repos/dask/distributed","labels_url":"https://api.github.com/repos/dask/distributed/issues/180/labels{/name}","comments_url":"https://api.github.com/repos/dask/distributed/issues/180/comments","events_url":"https://api.github.com/repos/dask/distributed/issues/180/events","html_url":"https://github.com/dask/distributed/issues/180","id":139957655,"number":180,"title":"Collect and send AWS credentials","user":{"login":"mrocklin","id":306380,"avatar_url":"https://avatars.githubusercontent.com/u/306380?v=3","gravatar_id":"","url":"https://api.github.com/users/mrocklin","html_url":"https://github.com/mrocklin","followers_url":"https://api.github.com/users/mrocklin/followers","following_url":"https://api.github.com/users/mrocklin/following{/other_user}","gists_url":"https://api.github.com/users/mrocklin/gists{/gist_id}","starred_url":"https://api.github.com/users/mrocklin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mrocklin/subscriptions","organizations_url":"https://api.github.com/users/mrocklin/orgs","repos_url":"https://api.github.com/users/mrocklin/repos","events_url":"https://api.github.com/users/mrocklin/events{/privacy}","received_events_url":"https://api.github.com/users/mrocklin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2016-03-10T17:25:10Z","updated_at":"2016-04-13T21:44:24Z","closed_at":null,"body":"As we improve S3 support we might consider how best to send AWS credentials from a client machine with a local `.boto` or `.aws` file to the workers asked to do the actual reading from S3.\r\n\r\nOne approach would be to scrape the local file and propagate the existing `s3pars` dict that we use within the `read_block_from_s3` call run on each worker.  This is a bit tricky because, at the moment, we'll be sending credentials in the clear.  Presumably we could resolve this by relying on Tornado's built-in encryption features (how expensive is this?)\r\n\r\nIs there a better way to do this?  Presumably this is a common problem.\r\n\r\nDoes AWS support the generation of short-term tokens to read that we should be passing around instead of the full credential?"},"comment":{"url":"https://api.github.com/repos/dask/distributed/issues/comments/209661626","html_url":"https://github.com/dask/distributed/issues/180#issuecomment-209661626","issue_url":"https://api.github.com/repos/dask/distributed/issues/180","id":209661626,"user":{"login":"mrocklin","id":306380,"avatar_url":"https://avatars.githubusercontent.com/u/306380?v=3","gravatar_id":"","url":"https://api.github.com/users/mrocklin","html_url":"https://github.com/mrocklin","followers_url":"https://api.github.com/users/mrocklin/followers","following_url":"https://api.github.com/users/mrocklin/following{/other_user}","gists_url":"https://api.github.com/users/mrocklin/gists{/gist_id}","starred_url":"https://api.github.com/users/mrocklin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mrocklin/subscriptions","organizations_url":"https://api.github.com/users/mrocklin/orgs","repos_url":"https://api.github.com/users/mrocklin/repos","events_url":"https://api.github.com/users/mrocklin/events{/privacy}","received_events_url":"https://api.github.com/users/mrocklin/received_events","type":"User","site_admin":false},"created_at":"2016-04-13T21:44:24Z","updated_at":"2016-04-13T21:44:24Z","body":"The token indeed sounds very nice.  Presumably we would pass this as a parameter to our `distributed.s3.read_block_from_s3` function?"}}