{"action":"created","issue":{"url":"https://api.github.com/repos/RaiMan/SikuliX-2014/issues/210","repository_url":"https://api.github.com/repos/RaiMan/SikuliX-2014","labels_url":"https://api.github.com/repos/RaiMan/SikuliX-2014/issues/210/labels{/name}","comments_url":"https://api.github.com/repos/RaiMan/SikuliX-2014/issues/210/comments","events_url":"https://api.github.com/repos/RaiMan/SikuliX-2014/issues/210/events","html_url":"https://github.com/RaiMan/SikuliX-2014/issues/210","id":160895561,"number":210,"title":"Support for accessing devices not on the machine SikuliX works on (phones, vms, remote computers, ...)","user":{"login":"tg44","id":31839,"avatar_url":"https://avatars.githubusercontent.com/u/31839?v=3","gravatar_id":"","url":"https://api.github.com/users/tg44","html_url":"https://github.com/tg44","followers_url":"https://api.github.com/users/tg44/followers","following_url":"https://api.github.com/users/tg44/following{/other_user}","gists_url":"https://api.github.com/users/tg44/gists{/gist_id}","starred_url":"https://api.github.com/users/tg44/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tg44/subscriptions","organizations_url":"https://api.github.com/users/tg44/orgs","repos_url":"https://api.github.com/users/tg44/repos","events_url":"https://api.github.com/users/tg44/events{/privacy}","received_events_url":"https://api.github.com/users/tg44/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/RaiMan/SikuliX-2014/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":36,"created_at":"2016-06-17T14:04:11Z","updated_at":"2016-07-17T20:59:26Z","closed_at":null,"body":"Hy there! I love this tool, but it has a basic problem. If you want to automate things that are not on your computer, but you have basic api to get the actual picture, and how to click on it, you still need to lose a PC just because it can't handle this type of functionality.\r\n\r\nFor example browsers or phones or vms or remote computers.\r\n\r\nMy specific case is Android gameing automation. So I have a tool which can get pictures from a phone screen from adb. This tool can handle click to (x,y), and swipe from-to actions too. (It could do pich and some other gesture too, but I want only the swipe (aka drag and drop) and touch (aka click)) at first run.\r\n\r\nIt would be pretty nice if sikuli and the IDE could use some api as screen input, and some other api to click and drag and drop and other functions.\r\n\r\nI browsed the source, I think if I reimplement the Screen and Mouse classes that could be work. I have 2 problems with it: It's not the clean and generic way and I have no idea if it will work or not.\r\n\r\nSo basicly my questions:\r\n- Have you any advice about a mergable implementation, or its too complex, and an Android specific fork would be easyer?\r\n- If I reimplement the Screen and Mouse classes and modify the ide to be able to capture pictures from api screen instead of computer screen the run command can do its stuffs without touching the host computer?\r\n- Will be any headless/apiscreen support in the 2.0 version?\r\n\r\nIf I will have time and you say it's doable I really want to make a version that can handle Android devices thought adb and still enable to use the host computer,"},"comment":{"url":"https://api.github.com/repos/RaiMan/SikuliX-2014/issues/comments/233203736","html_url":"https://github.com/RaiMan/SikuliX-2014/issues/210#issuecomment-233203736","issue_url":"https://api.github.com/repos/RaiMan/SikuliX-2014/issues/210","id":233203736,"user":{"login":"RaiMan","id":586370,"avatar_url":"https://avatars.githubusercontent.com/u/586370?v=3","gravatar_id":"","url":"https://api.github.com/users/RaiMan","html_url":"https://github.com/RaiMan","followers_url":"https://api.github.com/users/RaiMan/followers","following_url":"https://api.github.com/users/RaiMan/following{/other_user}","gists_url":"https://api.github.com/users/RaiMan/gists{/gist_id}","starred_url":"https://api.github.com/users/RaiMan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/RaiMan/subscriptions","organizations_url":"https://api.github.com/users/RaiMan/orgs","repos_url":"https://api.github.com/users/RaiMan/repos","events_url":"https://api.github.com/users/RaiMan/events{/privacy}","received_events_url":"https://api.github.com/users/RaiMan/received_events","type":"User","site_admin":false},"created_at":"2016-07-17T20:59:26Z","updated_at":"2016-07-17T20:59:26Z","body":"revised/added:\r\n\r\n- device start/init/wakeup\r\n- input (input text) and delegation of Region(type)\r\n- click() did not target the device\r\n"}}
{"actor":{"display_login":"RaiMan"}}