{"action":"created","issue":{"url":"https://api.github.com/repos/nicholas-leonard/dp/issues/178","labels_url":"https://api.github.com/repos/nicholas-leonard/dp/issues/178/labels{/name}","comments_url":"https://api.github.com/repos/nicholas-leonard/dp/issues/178/comments","events_url":"https://api.github.com/repos/nicholas-leonard/dp/issues/178/events","html_url":"https://github.com/nicholas-leonard/dp/issues/178","id":124004882,"number":178,"title":"Does dp support 'image caption' data format?","user":{"login":"liuchang8am","id":1009550,"avatar_url":"https://avatars.githubusercontent.com/u/1009550?v=3","gravatar_id":"","url":"https://api.github.com/users/liuchang8am","html_url":"https://github.com/liuchang8am","followers_url":"https://api.github.com/users/liuchang8am/followers","following_url":"https://api.github.com/users/liuchang8am/following{/other_user}","gists_url":"https://api.github.com/users/liuchang8am/gists{/gist_id}","starred_url":"https://api.github.com/users/liuchang8am/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liuchang8am/subscriptions","organizations_url":"https://api.github.com/users/liuchang8am/orgs","repos_url":"https://api.github.com/users/liuchang8am/repos","events_url":"https://api.github.com/users/liuchang8am/events{/privacy}","received_events_url":"https://api.github.com/users/liuchang8am/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-12-28T01:24:54Z","updated_at":"2016-01-04T18:00:18Z","closed_at":"2016-01-04T18:00:18Z","body":"Say, dataset with image-sentence pairs, where image can be represented as raw or CNN feature vector, sentences can be represented as a sequence of one-hot vectors or simply indexed numbers. Is it possible to fit this kind of data to the dp dataset format (dp.DataSource maybe) ? It's kindof like the multi-target task, but the targets has order.\r\n\r\nbtw, thanks for the great work!"},"comment":{"url":"https://api.github.com/repos/nicholas-leonard/dp/issues/comments/168752845","html_url":"https://github.com/nicholas-leonard/dp/issues/178#issuecomment-168752845","issue_url":"https://api.github.com/repos/nicholas-leonard/dp/issues/178","id":168752845,"user":{"login":"nicholas-leonard","id":3520613,"avatar_url":"https://avatars.githubusercontent.com/u/3520613?v=3","gravatar_id":"","url":"https://api.github.com/users/nicholas-leonard","html_url":"https://github.com/nicholas-leonard","followers_url":"https://api.github.com/users/nicholas-leonard/followers","following_url":"https://api.github.com/users/nicholas-leonard/following{/other_user}","gists_url":"https://api.github.com/users/nicholas-leonard/gists{/gist_id}","starred_url":"https://api.github.com/users/nicholas-leonard/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nicholas-leonard/subscriptions","organizations_url":"https://api.github.com/users/nicholas-leonard/orgs","repos_url":"https://api.github.com/users/nicholas-leonard/repos","events_url":"https://api.github.com/users/nicholas-leonard/events{/privacy}","received_events_url":"https://api.github.com/users/nicholas-leonard/received_events","type":"User","site_admin":false},"created_at":"2016-01-04T18:00:18Z","updated_at":"2016-01-04T18:00:18Z","body":"@liuchang8am You can do it with a dp.ImageView for input and dp.ClassView (index numbers) for output. But all your sentences will need to have the same length (to fit them in tensor)."}}