06 – 3D model yourself

So…
You don’t know how to do 3D modelling but you know a little bit about programming and want to do cool stuff ?

Then read this post because today we will learn how to make a 3D model of a person in just 2sec from a photo !

Yes It works ! Check this out :

Cool stuff in action

The algorithm that does this is simple :
Give it a photo, and it will create a 3D model of the person in the photo.

Did I tried it my self ? Of course I did :

Because I got a 3D printer, I could print the generated 3D models
Think of the opportunities ! This could make great gifts, you could also make a candle with your shape, or import yourself in a video game !
The technology was used by the Corridor crew in one of their video:

So as you can see, even cool people use it, not just nerds

Ok, but how does it work ?

All the magic was made in the Facebook Reality Labs (or the Meta Reality Labs idk) And lucky for us, they have described all of their work in a paper :


https://shunsukesaito.github.io/PIFuHD/

Read it ! That’s an order

Their method consist of using a neural network architecture with several steps that can be independently trained, they state that :

“This approach significantly outperforms existing state-of-the-art techniques”

Doesn’t it sound great ?

They used for training hundreds of synthetically generated high quality scanned 3D human mesh models, you can by them here :
https://renderpeople.com/3d-people because why not?

Finally, if you want to try the algorithm yourself and maybe print a tiny you, you can find more information on their GitHub page :

https://github.com/facebookresearch/pifuhd

A direct link to something cool

I hope you have fun trying it, I know I did

Tiny French mom colourized (2020)

By Tom Mansion

Really into creating stuff. Check my website for more info on the projects I have worked on

2 comments

  1. Wow! That’s amazing! You can do anything with AI nowaday. What’s your 3d printer? I own a Prusa I3 MK2S is it something similar?
    Thanks for you article it was really interesting!

Leave a comment

Your email address will not be published. Required fields are marked *