Does Lip Sync Still Work?

If your topic doesn't fit anywhere else, put it here.

Moderator: joepal

Does Lip Sync Still Work?

Postby RamblingMan » Thu Jan 04, 2018 10:33 am

Hi. I've been attempting to lip sync with the mhx2 plugin but have been unsuccessful. So far I've used MakeHuman 1.1.1, 1.1.0, and 1.0.2, all with the same result. When I use rigify with "Face Shape" and "Face Drivers" checked all I get is the head and clicking the Visemes (MB, OO, O, etc) has no effect on the position of the mouth.

https://s18.postimg.org/5ughubk15/0ecf9a304789808fdececc98eefbaf8b98f87191_hq.jpg

This is true whether the MakeHuman model is rigged with Default, Game, or Basic. Importing the mhx2 file into Blender with "Rigging Type: Exported" yields the full mesh but the Visemes are similarly inoperable. If it helps, so far I've been following this tutorial:

https://www.youtube.com/watch?v=OGhnc14tssk

But I'm beginning to think that mhx2 only works for the nightly build he used. Could someone please identify what the problem is likely to be?
RamblingMan
 
Posts: 1
Joined: Thu Jan 04, 2018 9:35 am

Re: Does Lip Sync Still Work?

Postby MargaretToigo » Thu Jan 04, 2018 4:24 pm

I have the latest and greatest stable build of MakeHuman and I use Papagayo to create the .dat files and the Lipsync Importer plug-in in Blender to convert them into keyframes. It can use either shape keys or poses from a Pose Library.

The add-on is here:
https://wiki.blender.org/index.php/Exte ... c_Importer

And Papagayo is here:
http://my.smithmicro.com/papagayo.html

I did a whole series of videos using this method:

https://www.youtube.com/watch?v=ZCQjSoG ... KaxD6pJLIv
(I did the animation, graphics and sound editing/effects, I did not direct, edit or write them.)
MargaretToigo
 
Posts: 175
Joined: Thu Feb 16, 2017 6:46 pm
Location: Tampa Bay Florida, USA

Re: Does Lip Sync Still Work?

Postby brkurt » Thu Jan 04, 2018 7:08 pm

RamblingMan wrote:Hi. I've been attempting to lip sync with the mhx2 plugin but have been unsuccessful. So far I've used MakeHuman 1.1.1, 1.1.0, and 1.0.2, all with the same result. When I use rigify with "Face Shape" and "Face Drivers" checked all I get is the head and clicking the Visemes (MB, OO, O, etc) has no effect on the position of the mouth.

https://s18.postimg.org/5ughubk15/0ecf9a304789808fdececc98eefbaf8b98f87191_hq.jpg

This is true whether the MakeHuman model is rigged with Default, Game, or Basic. Importing the mhx2 file into Blender with "Rigging Type: Exported" yields the full mesh but the Visemes are similarly inoperable. If it helps, so far I've been following this tutorial:

https://www.youtube.com/watch?v=OGhnc14tssk

But I'm beginning to think that mhx2 only works for the nightly build he used. Could someone please identify what the problem is likely to be?


I've argued this before, http://www.makehumancommunity.org/forum/viewtopic.php?f=15&t=10750&p=24310&hilit=mystery+of+O#p24310

but it bears repeating. Lip Sync will never be reliable until is composed of a series of poses, not shape keys. The basic mesh / rig combinations are stable, but most people are hoping that shape keys created by someone out of the goodness of his heart is a technology that you can bet your career on. I would strongly suggest using the pose approach, because then the lip sync can be exported to other 3d apps, such as Marvelous Designer.
brkurt
 
Posts: 1100
Joined: Sun Feb 17, 2008 8:49 pm

Re: Does Lip Sync Still Work?

Postby Shaba1 » Wed Jun 13, 2018 5:00 pm

MargaretToigo wrote:I have the latest and greatest stable build of MakeHuman and I use Papagayo to create the .dat files and the Lipsync Importer plug-in in Blender to convert them into keyframes. It can use either shape keys or poses from a Pose Library.

The add-on is here:
https://wiki.blender.org/index.php/Exte ... c_Importer

And Papagayo is here:
http://my.smithmicro.com/papagayo.html

I did a whole series of videos using this method:

https://www.youtube.com/watch?v=ZCQjSoG ... KaxD6pJLIv
(I did the animation, graphics and sound editing/effects, I did not direct, edit or write them.)


nice animations. I subscribed
Shaba1
 
Posts: 164
Joined: Wed Mar 05, 2008 3:21 pm


Return to General discussions about makehuman

Who is online

Users browsing this forum: No registered users and 1 guest