{"action":"created","issue":{"url":"https://api.github.com/repos/awslabs/sockeye/issues/390","repository_url":"https://api.github.com/repos/awslabs/sockeye","labels_url":"https://api.github.com/repos/awslabs/sockeye/issues/390/labels{/name}","comments_url":"https://api.github.com/repos/awslabs/sockeye/issues/390/comments","events_url":"https://api.github.com/repos/awslabs/sockeye/issues/390/events","html_url":"https://github.com/awslabs/sockeye/pull/390","id":322234922,"number":390,"title":"Introducing the image captioning module","user":{"login":"lorisbaz","id":9000459,"avatar_url":"https://avatars3.githubusercontent.com/u/9000459?v=4","gravatar_id":"","url":"https://api.github.com/users/lorisbaz","html_url":"https://github.com/lorisbaz","followers_url":"https://api.github.com/users/lorisbaz/followers","following_url":"https://api.github.com/users/lorisbaz/following{/other_user}","gists_url":"https://api.github.com/users/lorisbaz/gists{/gist_id}","starred_url":"https://api.github.com/users/lorisbaz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lorisbaz/subscriptions","organizations_url":"https://api.github.com/users/lorisbaz/orgs","repos_url":"https://api.github.com/users/lorisbaz/repos","events_url":"https://api.github.com/users/lorisbaz/events{/privacy}","received_events_url":"https://api.github.com/users/lorisbaz/received_events","type":"User","site_admin":false},"labels":[{"id":837948970,"url":"https://api.github.com/repos/awslabs/sockeye/labels/feature","name":"feature","color":"0e8a16","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-05-11T09:45:03Z","updated_at":"2018-05-23T08:11:09Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/awslabs/sockeye/pulls/390","html_url":"https://github.com/awslabs/sockeye/pull/390","diff_url":"https://github.com/awslabs/sockeye/pull/390.diff","patch_url":"https://github.com/awslabs/sockeye/pull/390.patch"},"body":"Introducing the image captioning module. Type of models supported: ConvNet encoder - Sockeye NMT decoders\r\n\r\nFeatures:\r\n\r\n-   Image encoder that extracts features using preetrained nets: `image_captioning.encoder`\r\n-   Feature extraction script to dump features to disk `image_captioning.extract_features`\r\n-   Pass-through embedding, since we do not need it for images\r\n-   Image-text iterator that loads features on the fly during training with the option of loading all to memory: `image_captioning.data_io`\r\n-   Training and inference pipelines for image captioning: `image_captioning.train`, `image_captioning.inference` and `image_captioning.captioner`\r\n-   README with instructions on how to use the image captioning module: `image_captioning/README.md`\r\n-   Visualization script that loads images and captions (prediction+ground truth) and display them: `image_captioning.visualize`\r\n\r\n(description of the change)\r\n\r\n#### Pull Request Checklist ##\r\n- [x] Changes are complete (if posting work-in-progress code, prefix your pull request title with '[WIP]'\r\nuntil you can check this box.\r\n- [x] Unit tests pass (`pytest`)\r\n- [x] Were system tests modified? If so did you run these at least 5 times to account for the variation across runs? - Not modified!\r\n- [x] System tests pass (`pytest test/system`)\r\n- [x] Passed code style checking (`./style-check.sh`)\r\n- [x] You have considered writing a test\r\n- [x] Updated major/minor version in `sockeye/__init__.py`. Major version bump if this is a backwards incompatible change.\r\n- [x] Updated CHANGELOG.md\r\n\r\n\r\nBy submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/awslabs/sockeye/issues/comments/391259772","html_url":"https://github.com/awslabs/sockeye/pull/390#issuecomment-391259772","issue_url":"https://api.github.com/repos/awslabs/sockeye/issues/390","id":391259772,"user":{"login":"lorisbaz","id":9000459,"avatar_url":"https://avatars3.githubusercontent.com/u/9000459?v=4","gravatar_id":"","url":"https://api.github.com/users/lorisbaz","html_url":"https://github.com/lorisbaz","followers_url":"https://api.github.com/users/lorisbaz/followers","following_url":"https://api.github.com/users/lorisbaz/following{/other_user}","gists_url":"https://api.github.com/users/lorisbaz/gists{/gist_id}","starred_url":"https://api.github.com/users/lorisbaz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lorisbaz/subscriptions","organizations_url":"https://api.github.com/users/lorisbaz/orgs","repos_url":"https://api.github.com/users/lorisbaz/repos","events_url":"https://api.github.com/users/lorisbaz/events{/privacy}","received_events_url":"https://api.github.com/users/lorisbaz/received_events","type":"User","site_admin":false},"created_at":"2018-05-23T08:11:09Z","updated_at":"2018-05-23T08:11:09Z","author_association":"CONTRIBUTOR","body":"As mentioned in my previous comment, now tests are not downloading nets but creating a simple 2 conv layer net on the fly."}}
{"actor":{"display_login":"lorisbaz"}}