Body outline animation off of stick figure (pose estimation)

If your topic doesn't fit anywhere else, put it here.

Moderator: joepal

Body outline animation off of stick figure (pose estimation)

Postby MartheLue » Thu Dec 08, 2022 4:32 pm

Hey,

I launched an app quite successfully and we want to integrate a feature for which we need transparent video file of the body outline of people in an actual video.

Meaning we are building a web app on which we upload videos of people moving, pose estimation software is creating a stick figure of that person and we need an automatic animation that builds the body outline of the human based on the stick figure. The results will hopefully be the body outline moving around almost identical to the actual human in the original video. We stumbled across MakeHuman.

I'm a non-technical person but right now don't have a team of people do guide me so I decided to try my luck and reach out here to ask: Is this body outline feature possible to do with MakeHuman? If yes, do you have a rough guide on how to do that? If no, how else would you approach this?

Hoping to hear from someone :)
MartheLue
 
Posts: 4
Joined: Thu Dec 08, 2022 4:27 pm

Re: Body outline animation off of stick figure (pose estimat

Postby joepal » Thu Dec 08, 2022 5:43 pm

The normal way to do this would be via a proxy. To my knowledge, there is no such proxy available at the moment.

A proxy is designed in blender and then fed through the MakeClothes addon. The procedure is the same for clothes and proxies, except that the file is placed in the proxymeshes directory in the end, with a .proxy file extension. The documentation for MakeClothes is here: http://www.makehumancommunity.org/wiki/ ... :ClothesV2

An easily available alternative would be to use the already existing skeleton proxy, if that would be satisfactory. It is here: http://www.makehumancommunity.org/clothes/skeleton.html and can also be downloaded with the asset downloader from within the UI.
Joel Palmius (LinkedIn)
MakeHuman Infrastructure Manager
http://www.palmius.com/joel
joepal
 
Posts: 4346
Joined: Wed Jun 04, 2008 11:20 am

Re: Body outline animation off of stick figure (pose estimat

Postby MartheLue » Thu Dec 08, 2022 6:35 pm

Awesome!

Basically we would just need the outline of the gender neutral naked body.

I found some people on upwork that know about MakeHuman but since I'm right at the source here I might get lucky here: Can you point me towards people that can create such a proxy or do you know where best to find someone?
MartheLue
 
Posts: 4
Joined: Thu Dec 08, 2022 4:27 pm

Re: Body outline animation off of stick figure (pose estimat

Postby joepal » Fri Dec 09, 2022 11:39 am

Your best bet is to ask in the assets subforum here.

Possibly you could ask in a post at https://blenderartists.org/c/jobs/14 too, if you're prepared to pay for the job.
Joel Palmius (LinkedIn)
MakeHuman Infrastructure Manager
http://www.palmius.com/joel
joepal
 
Posts: 4346
Joined: Wed Jun 04, 2008 11:20 am

Re: Body outline animation off of stick figure (pose estimat

Postby tomcat » Fri Dec 09, 2022 12:06 pm

MartheLue wrote:Meaning we are building a web app on which we upload videos of people moving, pose estimation software is creating a stick figure of that person and we need an automatic animation that builds the body outline of the human based on the stick figure. The results will hopefully be the body outline moving around almost identical to the actual human in the original video. We stumbled across MakeHuman.

What are you making the app based on?

There is a similar function in shaders. For example, this is how it's done in Godot.

Image
Foreigners' reactions to Russian "Bird's Milk" candies
— Are birds being milked there?
— In Russia everyone is milked. Here even zucchinis lay caviar…
User avatar
tomcat
 
Posts: 207
Joined: Sun Sep 27, 2015 7:53 pm
Location: Moscow (Orcish Stan), The Aggressive Evil Empire

Re: Body outline animation off of stick figure (pose estimat

Postby MartheLue » Fri Dec 09, 2022 2:41 pm

Thank you!

I wonder if that's easier with distinct shapes like squares but not so much with the human body.

Please send me an email if you disagree and think you could help us out martheluebbers@gmail.com :)
MartheLue
 
Posts: 4
Joined: Thu Dec 08, 2022 4:27 pm

Re: Body outline animation off of stick figure (pose estimat

Postby tomcat » Fri Dec 09, 2022 6:58 pm

MartheLue wrote:I wonder if that's easier with distinct shapes like squares but not so much with the human body.

The rendering goes like this:

Godot_v3.5.1-stable_win64_QO40LhKSAp.png


Video (render):

Body_outline_animation.avi
218,4 МБ

https://mega.nz/file/eslmwSYa#3g2bXLR4z ... BZV57rQZqQ
https://www.mediafire.com/file/029s2lwz ... n.avi/file
Body_outline_animation.mp4
(595.58 KiB) Downloaded 21 times

https://files.mastodon.social/media_att ... d4dc5e.mp4

Unfortunately, I've only just begun to explore this dark side, so I wouldn't risk taking on serious work just yet. Although, if you can't find anyone, I might give it a try.


The game executable from the engine:

Body_outline_animation.zip (.exe)
File size: 191.05 (584) MB
https://mega.nz/file/u0UV3YKb#vpGFqYvCN ... rWQpksDmB0
https://www.mediafire.com/file/zzv27nb0 ... n.zip/file
Foreigners' reactions to Russian "Bird's Milk" candies
— Are birds being milked there?
— In Russia everyone is milked. Here even zucchinis lay caviar…
User avatar
tomcat
 
Posts: 207
Joined: Sun Sep 27, 2015 7:53 pm
Location: Moscow (Orcish Stan), The Aggressive Evil Empire

Re: Body outline animation off of stick figure (pose estimat

Postby jwc » Mon Dec 12, 2022 7:13 am

There is an issue that you should be aware of when you start to use a proxy like the one requested.
The position, rotation, and size of the "stick" is determined by:

(1) The position, rotation, and size of the armature bones for the body
(2) Those values are used to determine the position of all the vertices of a virtual skin around the armature.
(3) Three selected vertices from this skin are then used to set the position, rotation, and size of the stick.

This means the sticks are not an accurate representation of the armature position, but only an estimate. If you try a few poses with the existing "skeleton", you can see where close examination reveals gaps and overlaps.

As long as you are ok with the fact that the sticks are only an approximation of the body position, and they can overlap and separate, this method should work.

Presumably you are really working with the armature, and only using the sticks as a visual cue.
If that is the case, you possibly need three proxy's, one of sticks only, one transparent skin with internal sticks, and one transparent skin with no sticks.
jwc
 
Posts: 48
Joined: Sat Apr 27, 2013 11:59 pm


Return to General discussions about makehuman

Who is online

Users browsing this forum: No registered users and 1 guest