{"action":"created","comment":{"url":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/comments/200810532","pull_request_review_id":135202044,"id":200810532,"node_id":"MDI0OlB1bGxSZXF1ZXN0UmV2aWV3Q29tbWVudDIwMDgxMDUzMg==","diff_hunk":"@@ -0,0 +1,98 @@\n+# ss18_showmaster\n+Roboy wishes to be more entertaining and impressive. With his new skills he is reliably able to attract people to its presence independent to their relation to him. He appeals as well to an audience as to a group of developers, satisfying both of their preferences.\n+\n+\n+## About\n+This repository consists of four sections to make Roboy more entertaining on fairs.\n+1. Facial Expressions to show more emotions\n+2. Generative Model for Chitchat\n+3. Vision Module\n+4. Additions to Dialog for playing games\n+\n+Roboy Showmaster team wants to combine these sections to have an immersive and entertaining conversation.\n+\n+\n+## How it works\n+\n+\n+### 1. Facial Expressions\n+In addition to the old faces and expressions in Unity, the following faces & emotions were added by animating them in Unity and and can be triggered via ROS:\n+ - suprised Roboy\n+ - crying Roboy\n+ - irritated Roboy\n+ - Roboy wearing sunglasses\n+ \n+ The animations can be triggered via the code using Microsoft Visual Studies in RoboyUnityFace/Assets/RoboyAnimator.cs \n+ The corresponding computers must be connected using the same IP-address. Emotions can now be triggered via ROS. \n+\n+### 2. Generative Models\n+The old Generative Model was neither a state of the art implementation nor did it use a state of the art dataset as a basis. The new model is originating from Facebooks Dialog Research Platform [ParlAI](https://github.com/facebookresearch/ParlAI/). There, several state of the art implementations as well as several datasets are integrated in one platform. For Roboy, the profilememory implementation was choosen based on the Personachat dataset. \n+\n+### 3. Vision Module\n+The ROS Service Server receives service calls from the dialog as Strings that hold the desired filter. The vision module streams the video information from Roboy's camera to an iPad and applies the requested filter to the detected faces. The algorithm uses OpenCV and dlib library finding 68 facial landmarks to detect the most important face charateristics and to estimate the tilt angle of the face. The required filter mask is then applied automatically in-face superposition in real time. Following filters have been implemented: Roboy mask, mustache, pixelated sunglasses, flies, hat, crown and rainbow.\n+\n+### 4. Dialog Games\n+The Dialog implements two games: \n+\n+- The 20 questions game using an Akinator Wrapper API that is run in children protection mode and \n+\n+- the Snapchat-Game that communicates with the Vision Server and requests the desired filters through service calls.\n+\n+\n+## Getting Started\n+\n+### Prequisites and Setup\n+- for Emotions refer to [RoboyUnityFace](https://github.com/Roboy/RoboyUnityFace)\n+- for ParlAI refer to [ParlAI](https://github.com/Roboy/ParlAI/)\n+- for Games refer to [Roboy_Dialog](https://github.com/Roboy/roboy_dialog)\n+- for Snapchat refer to [Roboy_Snapchat](https://github.com/Roboy/roboy_snapchat)\n+\n+### Running ROS service\n+- Start rosmaster in terminal with \n+```\n+roscore\n+```\n+\n+#### Emotions\n+\n+Install Unity on your computer and pull RoboyUnityFace from GitHub. \n+\n+In order to test the animations, it is necessary to disconnect from ROS. This can be reached by changing the code in RoboyUnityFace/Assets/RoboyAnimator.cs The line which must be changed looks like follows. In this line of code, the offline toggle should be set to true.  ","path":"README.md","position":60,"original_position":60,"commit_id":"b7a4bd4c10260899b61e0e68e641ef4c8859512e","original_commit_id":"b7a4bd4c10260899b61e0e68e641ef4c8859512e","user":{"login":"missxa","id":15858520,"node_id":"MDQ6VXNlcjE1ODU4NTIw","avatar_url":"https://avatars3.githubusercontent.com/u/15858520?v=4","gravatar_id":"","url":"https://api.github.com/users/missxa","html_url":"https://github.com/missxa","followers_url":"https://api.github.com/users/missxa/followers","following_url":"https://api.github.com/users/missxa/following{/other_user}","gists_url":"https://api.github.com/users/missxa/gists{/gist_id}","starred_url":"https://api.github.com/users/missxa/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/missxa/subscriptions","organizations_url":"https://api.github.com/users/missxa/orgs","repos_url":"https://api.github.com/users/missxa/repos","events_url":"https://api.github.com/users/missxa/events{/privacy}","received_events_url":"https://api.github.com/users/missxa/received_events","type":"User","site_admin":false},"body":"this is not the place to write this. and the face instructions are incorrect","created_at":"2018-07-07T11:58:16Z","updated_at":"2018-07-07T12:00:23Z","html_url":"https://github.com/Roboy/ss18_showmaster/pull/2#discussion_r200810532","pull_request_url":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/2","author_association":"NONE","_links":{"self":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/comments/200810532"},"html":{"href":"https://github.com/Roboy/ss18_showmaster/pull/2#discussion_r200810532"},"pull_request":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/2"}}},"pull_request":{"url":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/2","id":192729867,"node_id":"MDExOlB1bGxSZXF1ZXN0MTkyNzI5ODY3","html_url":"https://github.com/Roboy/ss18_showmaster/pull/2","diff_url":"https://github.com/Roboy/ss18_showmaster/pull/2.diff","patch_url":"https://github.com/Roboy/ss18_showmaster/pull/2.patch","issue_url":"https://api.github.com/repos/Roboy/ss18_showmaster/issues/2","number":2,"state":"open","locked":false,"title":"Devel","user":{"login":"sebo313","id":29478970,"node_id":"MDQ6VXNlcjI5NDc4OTcw","avatar_url":"https://avatars3.githubusercontent.com/u/29478970?v=4","gravatar_id":"","url":"https://api.github.com/users/sebo313","html_url":"https://github.com/sebo313","followers_url":"https://api.github.com/users/sebo313/followers","following_url":"https://api.github.com/users/sebo313/following{/other_user}","gists_url":"https://api.github.com/users/sebo313/gists{/gist_id}","starred_url":"https://api.github.com/users/sebo313/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sebo313/subscriptions","organizations_url":"https://api.github.com/users/sebo313/orgs","repos_url":"https://api.github.com/users/sebo313/repos","events_url":"https://api.github.com/users/sebo313/events{/privacy}","received_events_url":"https://api.github.com/users/sebo313/received_events","type":"User","site_admin":false},"body":"Implementation of Snapchat filters","created_at":"2018-06-05T14:35:17Z","updated_at":"2018-07-07T12:00:23Z","closed_at":null,"merged_at":null,"merge_commit_sha":"7128cd1ecaff75ff862b8bd2ab389d50529ea86c","assignee":null,"assignees":[],"requested_reviewers":[],"requested_teams":[],"labels":[],"milestone":null,"commits_url":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/2/commits","review_comments_url":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/2/comments","review_comment_url":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/comments{/number}","comments_url":"https://api.github.com/repos/Roboy/ss18_showmaster/issues/2/comments","statuses_url":"https://api.github.com/repos/Roboy/ss18_showmaster/statuses/b7a4bd4c10260899b61e0e68e641ef4c8859512e","head":{"label":"Roboy:devel","ref":"devel","sha":"b7a4bd4c10260899b61e0e68e641ef4c8859512e","user":{"login":"Roboy","id":6785246,"node_id":"MDEyOk9yZ2FuaXphdGlvbjY3ODUyNDY=","avatar_url":"https://avatars2.githubusercontent.com/u/6785246?v=4","gravatar_id":"","url":"https://api.github.com/users/Roboy","html_url":"https://github.com/Roboy","followers_url":"https://api.github.com/users/Roboy/followers","following_url":"https://api.github.com/users/Roboy/following{/other_user}","gists_url":"https://api.github.com/users/Roboy/gists{/gist_id}","starred_url":"https://api.github.com/users/Roboy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Roboy/subscriptions","organizations_url":"https://api.github.com/users/Roboy/orgs","repos_url":"https://api.github.com/users/Roboy/repos","events_url":"https://api.github.com/users/Roboy/events{/privacy}","received_events_url":"https://api.github.com/users/Roboy/received_events","type":"Organization","site_admin":false},"repo":{"id":131869634,"node_id":"MDEwOlJlcG9zaXRvcnkxMzE4Njk2MzQ=","name":"ss18_showmaster","full_name":"Roboy/ss18_showmaster","owner":{"login":"Roboy","id":6785246,"node_id":"MDEyOk9yZ2FuaXphdGlvbjY3ODUyNDY=","avatar_url":"https://avatars2.githubusercontent.com/u/6785246?v=4","gravatar_id":"","url":"https://api.github.com/users/Roboy","html_url":"https://github.com/Roboy","followers_url":"https://api.github.com/users/Roboy/followers","following_url":"https://api.github.com/users/Roboy/following{/other_user}","gists_url":"https://api.github.com/users/Roboy/gists{/gist_id}","starred_url":"https://api.github.com/users/Roboy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Roboy/subscriptions","organizations_url":"https://api.github.com/users/Roboy/orgs","repos_url":"https://api.github.com/users/Roboy/repos","events_url":"https://api.github.com/users/Roboy/events{/privacy}","received_events_url":"https://api.github.com/users/Roboy/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/Roboy/ss18_showmaster","description":null,"fork":false,"url":"https://api.github.com/repos/Roboy/ss18_showmaster","forks_url":"https://api.github.com/repos/Roboy/ss18_showmaster/forks","keys_url":"https://api.github.com/repos/Roboy/ss18_showmaster/keys{/key_id}","collaborators_url":"https://api.github.com/repos/Roboy/ss18_showmaster/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/Roboy/ss18_showmaster/teams","hooks_url":"https://api.github.com/repos/Roboy/ss18_showmaster/hooks","issue_events_url":"https://api.github.com/repos/Roboy/ss18_showmaster/issues/events{/number}","events_url":"https://api.github.com/repos/Roboy/ss18_showmaster/events","assignees_url":"https://api.github.com/repos/Roboy/ss18_showmaster/assignees{/user}","branches_url":"https://api.github.com/repos/Roboy/ss18_showmaster/branches{/branch}","tags_url":"https://api.github.com/repos/Roboy/ss18_showmaster/tags","blobs_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/refs{/sha}","trees_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/trees{/sha}","statuses_url":"https://api.github.com/repos/Roboy/ss18_showmaster/statuses/{sha}","languages_url":"https://api.github.com/repos/Roboy/ss18_showmaster/languages","stargazers_url":"https://api.github.com/repos/Roboy/ss18_showmaster/stargazers","contributors_url":"https://api.github.com/repos/Roboy/ss18_showmaster/contributors","subscribers_url":"https://api.github.com/repos/Roboy/ss18_showmaster/subscribers","subscription_url":"https://api.github.com/repos/Roboy/ss18_showmaster/subscription","commits_url":"https://api.github.com/repos/Roboy/ss18_showmaster/commits{/sha}","git_commits_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/commits{/sha}","comments_url":"https://api.github.com/repos/Roboy/ss18_showmaster/comments{/number}","issue_comment_url":"https://api.github.com/repos/Roboy/ss18_showmaster/issues/comments{/number}","contents_url":"https://api.github.com/repos/Roboy/ss18_showmaster/contents/{+path}","compare_url":"https://api.github.com/repos/Roboy/ss18_showmaster/compare/{base}...{head}","merges_url":"https://api.github.com/repos/Roboy/ss18_showmaster/merges","archive_url":"https://api.github.com/repos/Roboy/ss18_showmaster/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/Roboy/ss18_showmaster/downloads","issues_url":"https://api.github.com/repos/Roboy/ss18_showmaster/issues{/number}","pulls_url":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls{/number}","milestones_url":"https://api.github.com/repos/Roboy/ss18_showmaster/milestones{/number}","notifications_url":"https://api.github.com/repos/Roboy/ss18_showmaster/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/Roboy/ss18_showmaster/labels{/name}","releases_url":"https://api.github.com/repos/Roboy/ss18_showmaster/releases{/id}","deployments_url":"https://api.github.com/repos/Roboy/ss18_showmaster/deployments","created_at":"2018-05-02T15:21:30Z","updated_at":"2018-05-02T15:21:33Z","pushed_at":"2018-07-07T11:21:45Z","git_url":"git://github.com/Roboy/ss18_showmaster.git","ssh_url":"git@github.com:Roboy/ss18_showmaster.git","clone_url":"https://github.com/Roboy/ss18_showmaster.git","svn_url":"https://github.com/Roboy/ss18_showmaster","homepage":null,"size":60095,"stargazers_count":0,"watchers_count":0,"language":null,"has_issues":true,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"archived":false,"open_issues_count":1,"license":{"key":"bsd-3-clause","name":"BSD 3-Clause \"New\" or \"Revised\" License","spdx_id":"BSD-3-Clause","url":"https://api.github.com/licenses/bsd-3-clause","node_id":"MDc6TGljZW5zZTU="},"forks":0,"open_issues":1,"watchers":0,"default_branch":"master"}},"base":{"label":"Roboy:master","ref":"master","sha":"b8c55998ad7fef1edc1ead4e5d3a51bd51dde9cd","user":{"login":"Roboy","id":6785246,"node_id":"MDEyOk9yZ2FuaXphdGlvbjY3ODUyNDY=","avatar_url":"https://avatars2.githubusercontent.com/u/6785246?v=4","gravatar_id":"","url":"https://api.github.com/users/Roboy","html_url":"https://github.com/Roboy","followers_url":"https://api.github.com/users/Roboy/followers","following_url":"https://api.github.com/users/Roboy/following{/other_user}","gists_url":"https://api.github.com/users/Roboy/gists{/gist_id}","starred_url":"https://api.github.com/users/Roboy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Roboy/subscriptions","organizations_url":"https://api.github.com/users/Roboy/orgs","repos_url":"https://api.github.com/users/Roboy/repos","events_url":"https://api.github.com/users/Roboy/events{/privacy}","received_events_url":"https://api.github.com/users/Roboy/received_events","type":"Organization","site_admin":false},"repo":{"id":131869634,"node_id":"MDEwOlJlcG9zaXRvcnkxMzE4Njk2MzQ=","name":"ss18_showmaster","full_name":"Roboy/ss18_showmaster","owner":{"login":"Roboy","id":6785246,"node_id":"MDEyOk9yZ2FuaXphdGlvbjY3ODUyNDY=","avatar_url":"https://avatars2.githubusercontent.com/u/6785246?v=4","gravatar_id":"","url":"https://api.github.com/users/Roboy","html_url":"https://github.com/Roboy","followers_url":"https://api.github.com/users/Roboy/followers","following_url":"https://api.github.com/users/Roboy/following{/other_user}","gists_url":"https://api.github.com/users/Roboy/gists{/gist_id}","starred_url":"https://api.github.com/users/Roboy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Roboy/subscriptions","organizations_url":"https://api.github.com/users/Roboy/orgs","repos_url":"https://api.github.com/users/Roboy/repos","events_url":"https://api.github.com/users/Roboy/events{/privacy}","received_events_url":"https://api.github.com/users/Roboy/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/Roboy/ss18_showmaster","description":null,"fork":false,"url":"https://api.github.com/repos/Roboy/ss18_showmaster","forks_url":"https://api.github.com/repos/Roboy/ss18_showmaster/forks","keys_url":"https://api.github.com/repos/Roboy/ss18_showmaster/keys{/key_id}","collaborators_url":"https://api.github.com/repos/Roboy/ss18_showmaster/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/Roboy/ss18_showmaster/teams","hooks_url":"https://api.github.com/repos/Roboy/ss18_showmaster/hooks","issue_events_url":"https://api.github.com/repos/Roboy/ss18_showmaster/issues/events{/number}","events_url":"https://api.github.com/repos/Roboy/ss18_showmaster/events","assignees_url":"https://api.github.com/repos/Roboy/ss18_showmaster/assignees{/user}","branches_url":"https://api.github.com/repos/Roboy/ss18_showmaster/branches{/branch}","tags_url":"https://api.github.com/repos/Roboy/ss18_showmaster/tags","blobs_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/refs{/sha}","trees_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/trees{/sha}","statuses_url":"https://api.github.com/repos/Roboy/ss18_showmaster/statuses/{sha}","languages_url":"https://api.github.com/repos/Roboy/ss18_showmaster/languages","stargazers_url":"https://api.github.com/repos/Roboy/ss18_showmaster/stargazers","contributors_url":"https://api.github.com/repos/Roboy/ss18_showmaster/contributors","subscribers_url":"https://api.github.com/repos/Roboy/ss18_showmaster/subscribers","subscription_url":"https://api.github.com/repos/Roboy/ss18_showmaster/subscription","commits_url":"https://api.github.com/repos/Roboy/ss18_showmaster/commits{/sha}","git_commits_url":"https://api.github.com/repos/Roboy/ss18_showmaster/git/commits{/sha}","comments_url":"https://api.github.com/repos/Roboy/ss18_showmaster/comments{/number}","issue_comment_url":"https://api.github.com/repos/Roboy/ss18_showmaster/issues/comments{/number}","contents_url":"https://api.github.com/repos/Roboy/ss18_showmaster/contents/{+path}","compare_url":"https://api.github.com/repos/Roboy/ss18_showmaster/compare/{base}...{head}","merges_url":"https://api.github.com/repos/Roboy/ss18_showmaster/merges","archive_url":"https://api.github.com/repos/Roboy/ss18_showmaster/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/Roboy/ss18_showmaster/downloads","issues_url":"https://api.github.com/repos/Roboy/ss18_showmaster/issues{/number}","pulls_url":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls{/number}","milestones_url":"https://api.github.com/repos/Roboy/ss18_showmaster/milestones{/number}","notifications_url":"https://api.github.com/repos/Roboy/ss18_showmaster/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/Roboy/ss18_showmaster/labels{/name}","releases_url":"https://api.github.com/repos/Roboy/ss18_showmaster/releases{/id}","deployments_url":"https://api.github.com/repos/Roboy/ss18_showmaster/deployments","created_at":"2018-05-02T15:21:30Z","updated_at":"2018-05-02T15:21:33Z","pushed_at":"2018-07-07T11:21:45Z","git_url":"git://github.com/Roboy/ss18_showmaster.git","ssh_url":"git@github.com:Roboy/ss18_showmaster.git","clone_url":"https://github.com/Roboy/ss18_showmaster.git","svn_url":"https://github.com/Roboy/ss18_showmaster","homepage":null,"size":60095,"stargazers_count":0,"watchers_count":0,"language":null,"has_issues":true,"has_projects":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"archived":false,"open_issues_count":1,"license":{"key":"bsd-3-clause","name":"BSD 3-Clause \"New\" or \"Revised\" License","spdx_id":"BSD-3-Clause","url":"https://api.github.com/licenses/bsd-3-clause","node_id":"MDc6TGljZW5zZTU="},"forks":0,"open_issues":1,"watchers":0,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/2"},"html":{"href":"https://github.com/Roboy/ss18_showmaster/pull/2"},"issue":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/issues/2"},"comments":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/issues/2/comments"},"review_comments":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/2/comments"},"review_comment":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/pulls/2/commits"},"statuses":{"href":"https://api.github.com/repos/Roboy/ss18_showmaster/statuses/b7a4bd4c10260899b61e0e68e641ef4c8859512e"}},"author_association":"NONE"}}
{"actor":{"display_login":"missxa"}}