{"action":"created","issue":{"url":"https://api.github.com/repos/powroupi/blender_mmd_tools/issues/90","repository_url":"https://api.github.com/repos/powroupi/blender_mmd_tools","labels_url":"https://api.github.com/repos/powroupi/blender_mmd_tools/issues/90/labels{/name}","comments_url":"https://api.github.com/repos/powroupi/blender_mmd_tools/issues/90/comments","events_url":"https://api.github.com/repos/powroupi/blender_mmd_tools/issues/90/events","html_url":"https://github.com/powroupi/blender_mmd_tools/issues/90","id":283146769,"number":90,"title":"lip sync","user":{"login":"Hogarth-MMD","id":10057979,"avatar_url":"https://avatars3.githubusercontent.com/u/10057979?v=4","gravatar_id":"","url":"https://api.github.com/users/Hogarth-MMD","html_url":"https://github.com/Hogarth-MMD","followers_url":"https://api.github.com/users/Hogarth-MMD/followers","following_url":"https://api.github.com/users/Hogarth-MMD/following{/other_user}","gists_url":"https://api.github.com/users/Hogarth-MMD/gists{/gist_id}","starred_url":"https://api.github.com/users/Hogarth-MMD/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Hogarth-MMD/subscriptions","organizations_url":"https://api.github.com/users/Hogarth-MMD/orgs","repos_url":"https://api.github.com/users/Hogarth-MMD/repos","events_url":"https://api.github.com/users/Hogarth-MMD/events{/privacy}","received_events_url":"https://api.github.com/users/Hogarth-MMD/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":30,"created_at":"2017-12-19T08:51:32Z","updated_at":"2018-05-24T14:54:56Z","closed_at":null,"author_association":"NONE","body":"https://sites.google.com/site/khuuyjblend/home/blender/script/lipsync\r\n\r\nHere is a lip synchronization tool by a Japanese author which uses Blender, Python, and an open source speech recognition engine called Julius. It may be awhile before I have time to take a look at it, but maybe someone else might like to look at it now, so I am sharing the link now. Any thoughts about how this could be adapted to MMD and mmd_tools? The ideal would be a direct conversion of an audio file to a VMD talking animation, to speed up making a lip sync animation.\r\n "},"comment":{"url":"https://api.github.com/repos/powroupi/blender_mmd_tools/issues/comments/391744899","html_url":"https://github.com/powroupi/blender_mmd_tools/issues/90#issuecomment-391744899","issue_url":"https://api.github.com/repos/powroupi/blender_mmd_tools/issues/90","id":391744899,"user":{"login":"nagadomi","id":287255,"avatar_url":"https://avatars1.githubusercontent.com/u/287255?v=4","gravatar_id":"","url":"https://api.github.com/users/nagadomi","html_url":"https://github.com/nagadomi","followers_url":"https://api.github.com/users/nagadomi/followers","following_url":"https://api.github.com/users/nagadomi/following{/other_user}","gists_url":"https://api.github.com/users/nagadomi/gists{/gist_id}","starred_url":"https://api.github.com/users/nagadomi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nagadomi/subscriptions","organizations_url":"https://api.github.com/users/nagadomi/orgs","repos_url":"https://api.github.com/users/nagadomi/repos","events_url":"https://api.github.com/users/nagadomi/events{/privacy}","received_events_url":"https://api.github.com/users/nagadomi/received_events","type":"User","site_admin":false},"created_at":"2018-05-24T14:54:56Z","updated_at":"2018-05-24T14:54:56Z","author_association":"NONE","body":"OK, I may develop it when I have spare time, but I can't promise it.\r\n\r\n>And the maximum preview playback fps of a morphs animation (in Blender 2.79b) seems to be 30 fps.\r\n\r\nI often use 60 fps. You can change fps with `Render tab/Dimensions/Frame Rate`, and `sync-mode` on timeline windows to set `AV-sync`.\r\n\r\nbtw, \r\nI noticed that Julius strips complete silence frame(zero value). It causes a issue that sound sources and motion can not sync.\r\nA quick and dirty solution is to add noise to the sound source before processing.\r\n```\r\nsox tts.wav -p synth whitenoise vol 0.02 | sox -m tts.wav - tts_addednoise.wav\r\n```\r\n[tts_addednoise.wav.zip](https://github.com/powroupi/blender_mmd_tools/files/2035821/tts_addednoise.wav.zip)\r\n\r\n"}}
{"actor":{"display_login":"nagadomi"}}