{"action":"created","issue":{"url":"https://api.github.com/repos/deepfakes/faceswap/issues/462","repository_url":"https://api.github.com/repos/deepfakes/faceswap","labels_url":"https://api.github.com/repos/deepfakes/faceswap/issues/462/labels{/name}","comments_url":"https://api.github.com/repos/deepfakes/faceswap/issues/462/comments","events_url":"https://api.github.com/repos/deepfakes/faceswap/issues/462/events","html_url":"https://github.com/deepfakes/faceswap/issues/462","id":340821012,"node_id":"MDU6SXNzdWUzNDA4MjEwMTI=","number":462,"title":"Modify extractor to focus on mouth","user":{"login":"rosenb0rg","id":31511153,"node_id":"MDQ6VXNlcjMxNTExMTUz","avatar_url":"https://avatars2.githubusercontent.com/u/31511153?v=4","gravatar_id":"","url":"https://api.github.com/users/rosenb0rg","html_url":"https://github.com/rosenb0rg","followers_url":"https://api.github.com/users/rosenb0rg/followers","following_url":"https://api.github.com/users/rosenb0rg/following{/other_user}","gists_url":"https://api.github.com/users/rosenb0rg/gists{/gist_id}","starred_url":"https://api.github.com/users/rosenb0rg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rosenb0rg/subscriptions","organizations_url":"https://api.github.com/users/rosenb0rg/orgs","repos_url":"https://api.github.com/users/rosenb0rg/repos","events_url":"https://api.github.com/users/rosenb0rg/events{/privacy}","received_events_url":"https://api.github.com/users/rosenb0rg/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2018-07-12T22:32:12Z","updated_at":"2018-07-13T11:00:52Z","closed_at":null,"author_association":"NONE","body":"I'd like to modify the extractor script to focus on the lower half of the face - specifically the mouth area. \r\n\r\nI'm experimenting with changing people's mouth movements, and I want to train a higher resolution \"mouth only\" network, so I can create new speech patterns that are re-composited onto the original footage. \r\n\r\nIs there a way to modify which facial landmarks the extractor looks at so it just takes the mouth?\r\n"},"comment":{"url":"https://api.github.com/repos/deepfakes/faceswap/issues/comments/404800920","html_url":"https://github.com/deepfakes/faceswap/issues/462#issuecomment-404800920","issue_url":"https://api.github.com/repos/deepfakes/faceswap/issues/462","id":404800920,"node_id":"MDEyOklzc3VlQ29tbWVudDQwNDgwMDkyMA==","user":{"login":"rosenb0rg","id":31511153,"node_id":"MDQ6VXNlcjMxNTExMTUz","avatar_url":"https://avatars2.githubusercontent.com/u/31511153?v=4","gravatar_id":"","url":"https://api.github.com/users/rosenb0rg","html_url":"https://github.com/rosenb0rg","followers_url":"https://api.github.com/users/rosenb0rg/followers","following_url":"https://api.github.com/users/rosenb0rg/following{/other_user}","gists_url":"https://api.github.com/users/rosenb0rg/gists{/gist_id}","starred_url":"https://api.github.com/users/rosenb0rg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rosenb0rg/subscriptions","organizations_url":"https://api.github.com/users/rosenb0rg/orgs","repos_url":"https://api.github.com/users/rosenb0rg/repos","events_url":"https://api.github.com/users/rosenb0rg/events{/privacy}","received_events_url":"https://api.github.com/users/rosenb0rg/received_events","type":"User","site_admin":false},"created_at":"2018-07-13T11:00:52Z","updated_at":"2018-07-13T11:00:52Z","author_association":"NONE","body":"I get this:\r\n\r\nFailed to extract from image: C:\\local\\src\\deepfakes\\test\\test.jpg. Reason: shapes (2,51) and (2,2) not aligned: 51 (dim 1) != 2 (dim 0)\r\n\r\nTraceback (most recent call last):\r\n  File \"faceswap.py\", line 36, in <module>\r\n    ARGUMENTS.func(ARGUMENTS)\r\n  File \"C:\\local\\src\\deepfakes\\lib\\cli.py\", line 81, in execute_script\r\n    process.process()\r\n  File \"C:\\local\\src\\deepfakes\\scripts\\extract.py\", line 43, in process\r\n    self.extract_single_process()\r\n  File \"C:\\local\\src\\deepfakes\\scripts\\extract.py\", line 56, in extract_single_process\r\n    filename, faces = self.process_single_image(filename)\r\n  File \"C:\\local\\src\\deepfakes\\scripts\\extract.py\", line 94, in process_single_image\r\n    for idx, face in process_faces]\r\n  File \"C:\\local\\src\\deepfakes\\scripts\\extract.py\", line 94, in <listcomp>\r\n    for idx, face in process_faces]\r\n  File \"C:\\local\\src\\deepfakes\\scripts\\extract.py\", line 115, in process_single_face\r\n    self.faces.align_eyes)\r\n  File \"C:\\local\\src\\deepfakes\\plugins\\Extract_Align.py\", line 11, in extract\r\n    alignment = get_align_mat(face, size, align_eyes)\r\n  File \"C:\\local\\src\\deepfakes\\lib\\aligner.py\", line 29, in get_align_mat\r\n    mat_umeyama = umeyama(numpy.array(face.landmarks_as_xy()[17:]), landmarks_2D, True)[0:2]\r\n  File \"C:\\local\\src\\deepfakes\\lib\\umeyama.py\", line 49, in umeyama\r\n    A = np.dot(dst_demean.T, src_demean) / num\r\nValueError: shapes (2,51) and (2,2) not aligned: 51 (dim 1) != 2 (dim 0)"}}
{"actor":{"display_login":"rosenb0rg"}}