{"action":"created","issue":{"url":"https://api.github.com/repos/DataBiosphere/azul/issues/374","repository_url":"https://api.github.com/repos/DataBiosphere/azul","labels_url":"https://api.github.com/repos/DataBiosphere/azul/issues/374/labels{/name}","comments_url":"https://api.github.com/repos/DataBiosphere/azul/issues/374/comments","events_url":"https://api.github.com/repos/DataBiosphere/azul/issues/374/events","html_url":"https://github.com/DataBiosphere/azul/pull/374","id":366477838,"node_id":"MDExOlB1bGxSZXF1ZXN0MjIwMTQxOTU2","number":374,"title":"Redirect clients to download content from S3","user":{"login":"shiroyuki","id":226612,"node_id":"MDQ6VXNlcjIyNjYxMg==","avatar_url":"https://avatars0.githubusercontent.com/u/226612?v=4","gravatar_id":"","url":"https://api.github.com/users/shiroyuki","html_url":"https://github.com/shiroyuki","followers_url":"https://api.github.com/users/shiroyuki/followers","following_url":"https://api.github.com/users/shiroyuki/following{/other_user}","gists_url":"https://api.github.com/users/shiroyuki/gists{/gist_id}","starred_url":"https://api.github.com/users/shiroyuki/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shiroyuki/subscriptions","organizations_url":"https://api.github.com/users/shiroyuki/orgs","repos_url":"https://api.github.com/users/shiroyuki/repos","events_url":"https://api.github.com/users/shiroyuki/events{/privacy}","received_events_url":"https://api.github.com/users/shiroyuki/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":8,"created_at":"2018-10-03T18:51:04Z","updated_at":"2018-10-19T18:32:54Z","closed_at":null,"author_association":"COLLABORATOR","pull_request":{"url":"https://api.github.com/repos/DataBiosphere/azul/pulls/374","html_url":"https://github.com/DataBiosphere/azul/pull/374","diff_url":"https://github.com/DataBiosphere/azul/pull/374.diff","patch_url":"https://github.com/DataBiosphere/azul/pull/374.patch"},"body":"(Resolves #356)\r\n\r\nIn order to resolve the issue around the limit on the size of the response payload for AWS Lambda (6 MB at the time of implementation) and ensure that the response is achievable within 30 seconds, this updates makes the manifest API utilize a private S3 bucket as an intermediate storage for downloadable content and redirect the client to that downloadable content on S3 via an associated pre-signed URL with HTTP 302.\r\n\r\n#### Potential Known Issues\r\n\r\nIterating through large result from ElasticSearch may affect how much data we can write to S3 before the response time exceeds 30 seconds.\r\n\r\n#### New Environment Variables\r\n\r\n| Environment Variable | Description | Required | Default Value |\r\n| --- | --- | --- | --- |\r\n| `AZUL_S3_BUCKET` | The name of S3 bucket used by Azul | No | `azul-storage-$AZUL_DEPLOYMENT_STAGE` |\r\n\r\n#### Permission Updates\r\n\r\nThe web service lambda function `azul-service-*` will have `s3::GetObject` and `s3::PutObject` on the corresponding S3 bucket (as specified in `AZUL_S3_BUCKET`).\r\n\r\n#### Infrastructure Updates\r\n\r\nThe Terraform script has been updated with provisioning a new S3 bucket as specified in `AZUL_S3_BUCKET`."},"comment":{"url":"https://api.github.com/repos/DataBiosphere/azul/issues/comments/431457076","html_url":"https://github.com/DataBiosphere/azul/pull/374#issuecomment-431457076","issue_url":"https://api.github.com/repos/DataBiosphere/azul/issues/374","id":431457076,"node_id":"MDEyOklzc3VlQ29tbWVudDQzMTQ1NzA3Ng==","user":{"login":"shiroyuki","id":226612,"node_id":"MDQ6VXNlcjIyNjYxMg==","avatar_url":"https://avatars0.githubusercontent.com/u/226612?v=4","gravatar_id":"","url":"https://api.github.com/users/shiroyuki","html_url":"https://github.com/shiroyuki","followers_url":"https://api.github.com/users/shiroyuki/followers","following_url":"https://api.github.com/users/shiroyuki/following{/other_user}","gists_url":"https://api.github.com/users/shiroyuki/gists{/gist_id}","starred_url":"https://api.github.com/users/shiroyuki/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shiroyuki/subscriptions","organizations_url":"https://api.github.com/users/shiroyuki/orgs","repos_url":"https://api.github.com/users/shiroyuki/repos","events_url":"https://api.github.com/users/shiroyuki/events{/privacy}","received_events_url":"https://api.github.com/users/shiroyuki/received_events","type":"User","site_admin":false},"created_at":"2018-10-19T18:32:54Z","updated_at":"2018-10-19T18:32:54Z","author_association":"COLLABORATOR","body":"Based on recommendation from @hannes-ucsc, to fix the broken test on Travis CI, `BOTO_CONFIG` will be set to `/dev/null` so that we don't have to install `google-compute-engine`. This will be ready for review again once the tests pass on Travis CI."}}
{"actor":{"display_login":"shiroyuki"}}