{"action":"created","issue":{"url":"https://api.github.com/repos/Unity-Technologies/ml-agents/issues/1105","repository_url":"https://api.github.com/repos/Unity-Technologies/ml-agents","labels_url":"https://api.github.com/repos/Unity-Technologies/ml-agents/issues/1105/labels{/name}","comments_url":"https://api.github.com/repos/Unity-Technologies/ml-agents/issues/1105/comments","events_url":"https://api.github.com/repos/Unity-Technologies/ml-agents/issues/1105/events","html_url":"https://github.com/Unity-Technologies/ml-agents/issues/1105","id":352392261,"node_id":"MDU6SXNzdWUzNTIzOTIyNjE=","number":1105,"title":"Rewards from Image Classification ?","user":{"login":"shrirammoni","id":28861120,"node_id":"MDQ6VXNlcjI4ODYxMTIw","avatar_url":"https://avatars1.githubusercontent.com/u/28861120?v=4","gravatar_id":"","url":"https://api.github.com/users/shrirammoni","html_url":"https://github.com/shrirammoni","followers_url":"https://api.github.com/users/shrirammoni/followers","following_url":"https://api.github.com/users/shrirammoni/following{/other_user}","gists_url":"https://api.github.com/users/shrirammoni/gists{/gist_id}","starred_url":"https://api.github.com/users/shrirammoni/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shrirammoni/subscriptions","organizations_url":"https://api.github.com/users/shrirammoni/orgs","repos_url":"https://api.github.com/users/shrirammoni/repos","events_url":"https://api.github.com/users/shrirammoni/events{/privacy}","received_events_url":"https://api.github.com/users/shrirammoni/received_events","type":"User","site_admin":false},"labels":[{"id":687381590,"node_id":"MDU6TGFiZWw2ODczODE1OTA=","url":"https://api.github.com/repos/Unity-Technologies/ml-agents/labels/discussion","name":"discussion","color":"d4c5f9","default":false}],"state":"open","locked":false,"assignee":{"login":"vincentpierre","id":28320361,"node_id":"MDQ6VXNlcjI4MzIwMzYx","avatar_url":"https://avatars3.githubusercontent.com/u/28320361?v=4","gravatar_id":"","url":"https://api.github.com/users/vincentpierre","html_url":"https://github.com/vincentpierre","followers_url":"https://api.github.com/users/vincentpierre/followers","following_url":"https://api.github.com/users/vincentpierre/following{/other_user}","gists_url":"https://api.github.com/users/vincentpierre/gists{/gist_id}","starred_url":"https://api.github.com/users/vincentpierre/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vincentpierre/subscriptions","organizations_url":"https://api.github.com/users/vincentpierre/orgs","repos_url":"https://api.github.com/users/vincentpierre/repos","events_url":"https://api.github.com/users/vincentpierre/events{/privacy}","received_events_url":"https://api.github.com/users/vincentpierre/received_events","type":"User","site_admin":false},"assignees":[{"login":"vincentpierre","id":28320361,"node_id":"MDQ6VXNlcjI4MzIwMzYx","avatar_url":"https://avatars3.githubusercontent.com/u/28320361?v=4","gravatar_id":"","url":"https://api.github.com/users/vincentpierre","html_url":"https://github.com/vincentpierre","followers_url":"https://api.github.com/users/vincentpierre/followers","following_url":"https://api.github.com/users/vincentpierre/following{/other_user}","gists_url":"https://api.github.com/users/vincentpierre/gists{/gist_id}","starred_url":"https://api.github.com/users/vincentpierre/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vincentpierre/subscriptions","organizations_url":"https://api.github.com/users/vincentpierre/orgs","repos_url":"https://api.github.com/users/vincentpierre/repos","events_url":"https://api.github.com/users/vincentpierre/events{/privacy}","received_events_url":"https://api.github.com/users/vincentpierre/received_events","type":"User","site_admin":false}],"milestone":null,"comments":2,"created_at":"2018-08-21T05:39:16Z","updated_at":"2018-09-10T18:00:00Z","closed_at":null,"author_association":"NONE","body":"Hi,\r\n\r\nIs there any way to get rewards from image classification results?"},"comment":{"url":"https://api.github.com/repos/Unity-Technologies/ml-agents/issues/comments/420004476","html_url":"https://github.com/Unity-Technologies/ml-agents/issues/1105#issuecomment-420004476","issue_url":"https://api.github.com/repos/Unity-Technologies/ml-agents/issues/1105","id":420004476,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMDAwNDQ3Ng==","user":{"login":"vincentpierre","id":28320361,"node_id":"MDQ6VXNlcjI4MzIwMzYx","avatar_url":"https://avatars3.githubusercontent.com/u/28320361?v=4","gravatar_id":"","url":"https://api.github.com/users/vincentpierre","html_url":"https://github.com/vincentpierre","followers_url":"https://api.github.com/users/vincentpierre/followers","following_url":"https://api.github.com/users/vincentpierre/following{/other_user}","gists_url":"https://api.github.com/users/vincentpierre/gists{/gist_id}","starred_url":"https://api.github.com/users/vincentpierre/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vincentpierre/subscriptions","organizations_url":"https://api.github.com/users/vincentpierre/orgs","repos_url":"https://api.github.com/users/vincentpierre/repos","events_url":"https://api.github.com/users/vincentpierre/events{/privacy}","received_events_url":"https://api.github.com/users/vincentpierre/received_events","type":"User","site_admin":false},"created_at":"2018-09-10T18:00:00Z","updated_at":"2018-09-10T18:00:00Z","author_association":"CONTRIBUTOR","body":"If I understand correctly, you want your agents to move around in the scene and place themselves to form an image. I have never thought of such a task and I think this is an interesting challenge. I would first try with very simple images and task and then gradually increase the difficulty. I think the inputs should be the target image, the current image, and information specific to the agent (position, color, etc...). I would then probably reward the agents at each time step for how close the target and screenshot are. I hope this helps."}}
{"actor":{"display_login":"vincentpierre"}}