Page 1 of 2

Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Sat Oct 03, 2020 3:21 pm
by HunanbeanCollective
Hello. I have made a full viseme set, in Target form, for MakeHuman and Blender. I have also added a matching phoneme breakdown set to Papagayo-NG.
Until the merge with Papagayo-NG is complete, you can download the additions from the Hunanbean-Collective Github page https://github.com/Hunanbean-Collective/.
there you will find the MakeHuman targets, and the files you need to copy to Papagayo-NG to allow for a full phoneme breakdown.
I use the MakeShapes addon https://github.com/AssetDK/makeshapes to import the Targets into Blender
I use the LipSync Importer & Blinker https://github.com/iCEE-HAM/io_import_lipSync-blender2.8 to bring these to life in Blender.

I will be creating and posting a series of instructional videos and texts shortly, and will post a link here when they are ready for viewing.

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Sun Oct 04, 2020 8:56 am
by punkduck
Hi

I just did a quick look, looks interesting :)

Be careful, the code seems to be Windows only ...

Code: Select all
filename, extension = os.path.splitext(dirName + "\\" + file)


you should change that to:

Code: Select all
filename, extension = os.path.splitext(os.path.join(dirName, file))


to make the linux and MacOS users happy, They use the slash and not the backslash and python os.path is simply encapsulating this difference.

Greetings from another guy on github who used most of his free time to find errors in the last weeks :)

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Sun Oct 04, 2020 12:34 pm
by HunanbeanCollective
Thank you for taking a look :D

my question is, which code are you refering to? the Targets and the Phoneme set on hunanbean-collective github should all be, essentially, code agnostic.
Are you refering to the folder structure i used on github, or perhaps one of the other code bases i linked to?

definitely want to fix any problems a.s.a.p

Thank you

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Sun Oct 04, 2020 1:10 pm
by HunanbeanCollective
Here is a link to a quick video of a stylized female character head-shot using these visemes

https://youtu.be/Y6pfMW6QyIE

I consider this beta 0.4
I intend to update rather quickly

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Wed Oct 07, 2020 9:59 pm
by HunanbeanCollective
No more jumping through hoops to get the visemes fully functional on your character!

I have incorporated the full viseme set into the MHX2 importer. Equipping the visemes on your character is now just a checkbox away. 8-) (well, that and replacing a file in the plugins folder)

The replacement file is located in the faceshapes folder on my git https://github.com/Hunanbean-Collective/MakeHuman-Additions Along with some basic instructions on installation and usage.

Please enjoy!

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Fri Jun 04, 2021 10:51 pm
by billjamzz
I know this is old link, but did you make a tutorial on how to use these visemes? You mention a check box in MHX2, but where? I'm using 1.2.0 MH and Blender 2.92.0 on MacOS.

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Sat Jul 03, 2021 5:04 am
by HunanbeanCollective
Just saw your message. apologies for the delay in response.
I did not make a video yet on how to install due a perceived lack of interest, but there are text instructions on the git. They will be a bit different for mac, i would imagine.
Basically, all you need to do is replace the faceshapes.mxa in the blender plugins>mhx plugin folder with the one from my git. https://github.com/Hunanbean-Collective/MakeHuman-Additions
As far as the checkmark, i just meant that all you have to do after replacing that file is checkmark the 'faceshapes' box when importing your mhx into blender. The actual lipsync mapping part is handled by Papagayo-NG which has integrated my expanded viseme set as default, and just today released an automated version with speech recognition! After you export your lipsync data from Papagayo-NG you the use the lipsync plugin for blender https://github.com/iCEE-HAM/io_import_lipSync-blender2.8 and select the mesh, set the 'import file' to the .dat file and set your ease in and ease out to 4. Then you can watch the magic :)

let me know how it goes, and if you have any issues

Be well!

summary:
Replace faceshapes.mxa file with mine and select faceshapes checkbox when importing to blender (MHX)
Use Papagayo-NG to create the lipsync timing data (As of today, now automated with speech recognition!!!)
Use the Lipsync plugin in blender to read and apply the .dat lipsync data from Papagayo-NG to your MakeHuman made human

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Thu Apr 20, 2023 5:44 am
by abelinkin
Hi HunanbeanCollective! Thanks for making the viseme set and taking the time to document this process. I have followed the steps mentioned and the MH model only has all the facial shapekeys but no pose library. As a result, the animation does not occur after selecting mesh and importing the Papagayo dat file. Am I missing something very basic in my process? Thank you.

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Fri Apr 21, 2023 8:21 am
by abelinkin
Also, the mouth shapes recognised by Papagayo seem to be only limited to "AI E etc FV L MB P O rest U WQ" so how do I implement the 36 shapekeys for lipsync?

Re: Full 39 Viseme, Papagayo-NG incorporated set of Targets

PostPosted: Thu Dec 07, 2023 7:07 pm
by HunanbeanCollective
abelinkin wrote:Hi HunanbeanCollective! Thanks for making the viseme set and taking the time to document this process. I have followed the steps mentioned and the MH model only has all the facial shapekeys but no pose library. As a result, the animation does not occur after selecting mesh and importing the Papagayo dat file. Am I missing something very basic in my process? Thank you.



Sorry for the delayed response. I am not generally getting notifications.
It does not use the Pose Library, it uses Keyframed Shapekeys, so use the other option, and give that a shot!