Kinect skeleton tracking mapped to Makehuman model?

[Khrist Safalhai]

Hello MH Team,

I want to map Kinect skeleton capture data to MH model in Blender, I am using rigged MHX model for it.
First part is to get the joint location of the User through Kinect, This I have done, and I have real time Joint location of major joints of user in Blender.
now in Second part I want to map these joint locations to my MH Model so that it mimic user's action.
Is this possible in real time, if yes could you suggest any way in which I should approach this, My first naive thought was to one-to-one mapping from user to mh model
after working sometime I realized this is not going to work, infact I am totally lost in making the MHX rig control progrmmatically, Could you also point out any script or resource
which deals with this kind of behaviour.

Many thanks for your time

[dmbasso]

Hi Khrist,

I'd suggest for you to try using the IK constraints to guide the model. Something like:

Code: Select all

bpy.ops.object.select_name(name="MHXModel")
bpy.ops.object.mode_set(mode='POSE')

pb = bpy.context.active_object.pose.bones

c = pb['Foot_L'].constraints['FreeIK']
c.target = bpy.context.scene.objects['KinectFootL']

c = pb['Foot_R'].constraints['FreeIK']
c.target = bpy.context.scene.objects['KinectFootR']

c = pb['Hand_L'].constraints['FreeIK']
c.target = bpy.context.scene.objects['KinectHandL']

c = pb['Hand_R'].constraints['FreeIK']
c.target = bpy.context.scene.objects['KinectHandR']


Please tell us how does this work out.
Cheers,
Daniel

[Khrist Safalhai]

Thanks very much for this guidance, I am on it