Use PIFuHD to Create a 3D Model of Anyone from a Single Photo

Подписаться 917

Просмотров 129 тыс.

50% 1

March 24, 2023: Fixed! This Colab is old and was giving errors, I have updated it to import the correct libraries. Had good results with a standard stock photo of a person standing. Updated Colab Notebook: colab.research.google.com/git...
Result from my tests of the fixed colab here: • Result from PIFuHD, Ma...
April 24, 2022: Google just released PHORHUM phorhum.github.io/, which can not only create 3d models from a single photo of a person, but also animate them! Also FaceBuilder for Blender can create detailed faces with just a couple photos: keentools.io/products/facebui...
February 22, 2022 NOTE: I got a few comments that the colab wasn't working. I just verified that it does still work. I tried the default image, then tried again with an image I uploaded of Keanu Reeves. The result is here: • Result from PIFuHD, Fe... Please make sure you follow the instructions exactly. If you get errors when uploading your own image, make sure that it does not exceed 60kb in size and that you go through each step after upload.
ANOTHER NOTE: Machine Learning progresses very quickly. The PIFuHD paper, code, and this colab are already quite "old". Newer tools now exist for transforming images (not just people) into 3d meshes, for example NVIDIA Omniverse/Kaolin. If you want to generate face meshes, StyleSDF (github.com/royorel/StyleSDF) has a colab that is very easy to use. I hope you will explore those other tools. Good luck!
Original Paper: shunsukesaito.github.io/PIFuHD/

Опубликовано:

12 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 110

@jackson501100 3 года назад

Ran into an issue w/ rendering. Was able to download the object, so that is exciting!!!! Thank you for this tutorial. It really helped. I went step by step pausing where needed. Thank you again sir! I appreciate you!

@RiverReeves23 2 года назад

Thanks man, that is the most clear tutorial on how to do this. Someone else had a vid and it came up with errors. Your's worked perfectly!

@Raksasa187 Год назад

amazing and super handy for background characters!! Thank you so much for the clear tutorial

@jamesdutoit 2 года назад

Absolutely fantastic! Thank you, Sir.

@belkaosef7298 Год назад

getting to the point direcly ! thanks a lot man !

@user-vl8qg1vj8l 2 года назад

This is amazing!! Thank you!

@PambanSwamigalArul Год назад

Thanks a lot for the detailed tutorial

@SuperMassman 3 года назад

Thank you,,, one more tool for my new hobby playing with Blender

@jareddinwiddie2332 2 года назад

So these can be used in blender?

@montymole297 2 года назад

@@jareddinwiddie2332 Yes, they can be downloaded as OBJ, which are files that Blender can import.

@Rain0015 3 года назад

Thanks

@vvortex157 Год назад

damn, that statue can become a creepy monster for a game

@shadow_dancer 2 года назад

Interesting... One question - is it possible to use several pictures of the same person to get better mesh result at the end? Or this only works with single picture?

@brushrunner Год назад

anyone?

@panman69420 Год назад

no.

@clownworldhouse 3 года назад

Darn impressive

@justicemagagane5737 3 года назад

its ok bro you can say 'damn'

@clownworldhouse 3 года назад

@Justice Magagane d*mn 😯

@justicemagagane5737 3 года назад

@@clownworldhouse lol wtf

@SkyShazad Год назад

This is an Awesome Video my Dude.. My question is, When its done , and ive downloaded my model etc , and now i want to try the Process again do i need to start the whole process again??? as thats what im doing

@moses5407 Год назад

Can circumferential and other measures be pulled from this directly ... Or is it via blender in some way?

@badcapybara 2 года назад

Hey, great tut, thanks a lot for the effort! Does it also generate missing textures?

@montymole297 2 года назад

This tutorial shows how to add textures: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-kERzhJKYvGo.html

@alizee3687 Год назад

Wao... fantastic I even run into one issue. Part of my image exploded in 3D transformation but everything was available in one frame i.e. leg was few cm away from main body and stomach was ripped open. I think it's because I choose low resolution image. Other then that all went fine

@wgalloPT 3 года назад

Question....how do i go by outputting multiple frames of a small animation? do i have to run it all over everytime?

@wendeng6279 Год назад

At the last step, I got error message: valueerror not enough values to unpack( expected 4, got 0), anybody have the same problem? thanks.

@karubrandao Год назад

I'm trying to learn about ICON (implicit clothed humans obtained from normals) and Nvidia's nerf. Could you please try to do a tutorial (with texture) about these 2 because it seems they are the best till now for this purpose. Thank you!

@crider9260 2 года назад

Can you use multiple images to improve quality?

@amattomy 3 года назад

here all the way from corridor crew

@jcbyy 3 года назад

haha same

@jonasloekke7696 2 года назад

Yep me too

@3dgiftz 2 года назад

😔

@user-kz5pz2zi3q 6 месяцев назад

I need to know how to add movement to the 3d model .. i need it for sign language project

@T1mothyTee 2 года назад

Hello is there a way to process a bunch of images as a batch? I want to upload about 100 images of people at once and have it generate a mesh for each of them. Thanks!

@DanteS-119 Год назад

you need to run this on your own system and write a program to do that for you....

@daiesison Год назад

How do you run StyleSDF with your own images? On the collab it just runs with its own images.

@moesaadi4601 2 года назад

So I saw another video where the guy used the original photo and pretty much stuck it to the final result model to give it color and texture, would that work if the model is missing some of the areas?

@johndavis1079 2 года назад

I'm doing it but it's not doing the image

@butterflystudio606 2 года назад

Hello sir ! I faced some difficulties downloading this part net = PoseEstimationWithMobileNet() checkpoint = torch.load('checkpoint_iter_370000.pth', map_location='cpu') load_state(net, checkpoint) get_rect(net.cuda(), [image_path], 512) and I couldn't fin d any files in recon how can I FIX THAT

@exogendesign4582 3 месяца назад

have you found fix? I also got this error. I wanted to turn a figure into 3d for trophy design.

@samchaw7837 2 года назад

i couldnt figure out , i am following all the instructions as you mentioned but my object files comes in sharttered pieces, not as one invidiual object, can you tell why its happening like that, thanks in advance

@gustavodegrossi4708 3 года назад

Excelent video ! Do yo know any easy way to put the texture back of the person? Or I have to do it on cinema 4D? Thanks!!!!!

@TheAgentMeme 3 года назад

the tutorial to put the textures back on ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-kERzhJKYvGo.html&ab_channel=FreedomArts-3DAnimation%26GameDeveloper

@Justkev______ 3 года назад

that's the same thing i want to know

@koushikvallam9277 8 месяцев назад

I'm getting an error as "No distributions found for pytorch3d" after running pytorch3d line

@ruchalian 2 года назад

creepy AI can make in a second at the same time if this helpful in the future for medical it would be great overall what i think today was very interesting i wanna try this.

@huytruong31127 2 года назад

If i want create table or chair 3D, can I do with this model?

@ramgladore Год назад

Kinda sorta worked for me but it still looked janky. Maybe the image I used too low rez.

@tabz4040 2 года назад

Error while finding module specification for 'apps.simple_test' (ModuleNotFoundError: No module named 'apps')

@tabz4040 2 года назад

any fix?

@DanFrederiksen 10 месяцев назад

it does make sense that a human shape is a fairly narrow expression space so it should actually be a fairly easy task. I would think it's vastly simpler than what midjourney does for instance. it should be quite possible to make 3D models with as good fidelity as our minds can. essentially perfect

@MrNutmegdesigns Год назад

Is this only for people or can it be of object as well?

@CyberPodMark2 Год назад

Will it work for 3d cartoon characters model from the picture?

@user-vl8qg1vj8l 2 года назад

I have one question! Is it possible with luggage?

@amankhan6552 Год назад

I get this error when i run pifuhd ValueError: not enough values to unpack (expected 4, got 0)

@hiksms Год назад

same

@sairajshinde5269 Год назад

it is not able to create obj file ,it is showing only the image .can someone help me with the issue plzz

@derekau533 Год назад

Just put in a fix in the colab, thanks for letting me know!

@brushrunner Год назад

Is there any version of this for the textures?

@user-kz5pz2zi3q 6 месяцев назад

How to add movements to the 3d model

@pabloa.colchadop.7409 2 года назад

Hi. How can I unistall or remove the pytorch 3d??

@Padma226 Год назад

i am receiving NameError: name 'image_path' is not defined

@C0smic_Star 2 года назад

Can this work with animated characters?

@PalKellyMedia 2 года назад

Please I need link to the website

@dayonmohler5893 3 года назад

Can you do this if computer doesn’t have gpu?

@randomplayer6461 2 года назад

how do you use a pc if it doesn't have a gpu. (every pc has a gpu)

@loscorralesdelasplazasdeto3586 2 года назад

For animls??

@snippetshub 2 года назад

This isn't working, as the latest commenters also stated. As for me, the error is when running the "from google collab import files" cell. No upload button is enabled AFTER CLICKING THE START BUTTON, and I got this message: "Upload widget is only available when the cell has been executed in the current browser session. Please rerun this cell to enable." Seriously??

@ginnieware1633 Год назад

3 times I have tried this and 3 times failed apparently the link above gives me a figure that is already in the system and no instructions on how to clear the field.

@noodlesmarsden 6 месяцев назад

I'm slightly late to the party but what happens when I have no files in results but followed every step you did?

@tomasalmiron1487 Год назад

"recon" is empty. :(

@Vishulash 10 месяцев назад

Same problem bro... Did you find solution???

@user-ks9hb2zw3t 9 месяцев назад

not enough values to unpack

@darkfantom5757 Год назад

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. torchvision 0.14.0+cu116 requires torch==1.13.0, but you have torch 1.6.0+cu101 which is incompatible. torchtext 0.14.0 requires torch==1.13.0, but you have torch 1.6.0+cu101 which is incompatible. torchaudio 0.13.0+cu116 requires torch==1.13.0, but you have torch 1.6.0+cu101 which is incompatible. fastai 2.7.10 requires torch=1.7, but you have torch 1.6.0+cu101 which is incompatible.

@darkfantom5757 Год назад

i do all by guide and model is broken

@chemonized Год назад

this doesn't work anymore, getting errors in your rendering section "could not find a version that satisfies the requirement" and on the Run PiFuHD section it gives this error: error cannot marching cubes cannot unpack non-iterable int object

@derekau533 Год назад

I have just updated the colab with fixes. Some libraries needed to be updated. Thanks for letting me know!

@chemonized Год назад

@@derekau533 man that's amazing so fast you updated it! Works great now! Thank you! Side question, it says maximum 60kb image, but can you run a higher resolution if you are making it use your own machine ?

@derekau533 Год назад

@@chemonized Yes, I think so.. bigger images just require more memory. You can try, then scale down if out of memory error occurs. Please remember this software is three years old now, which is ancient! The models are not super detailed. I'm sure there are better alternatives available now.

@tiberiusgrozav1438 Год назад

Hi there. Cool video but i get following error when running PIFuHD: "error cannot marching cubes cannot unpack non-iterable int object" As output in results/recon i only have the .png file and not the .obj file. The input file was under 60Kb as you said. What am I doing wrong?

@DR-to5hb Год назад

I also am only getting the png in output. Errors began in the render cell, and the two suggested options in that cell do not work for me.

@derekau533 Год назад

I just updated the colab with a fix, thanks for letting me know!

@larrylurex86 Год назад

Tip: Instead of posting only how it works and how it looks the whole process it would be much more usefull to show what requirements are needed and how to set all the dependencies required by colab or to get the process working at least! If you don't do that it's just a random video about something that probably it works only for you and few other users but if you want to get much more attention you should add all the settings that make this process working! Cheers.

@DanFrederiksen 10 месяцев назад

doesn't it include textures?

@sajithavijay6686 3 месяца назад

We can rige this ?

@johanneszwilling 4 месяца назад

Works now IF you fix the numpy issues. I had two with np.int and np.bool (/lib/sdf.py)

@destroyer7827 14 дней назад

what did u change exactly?

@velsein Год назад

doesn't work :/

@seekerandroses Год назад

hey is this no longer working?

@RuubRoyce Год назад

You only have a front faced picture to work with, yet this "AI" protocol struggled to determine which way was front?!

@avantgaarden 6 месяцев назад

how does it work with non-human figures?

@derekau533 6 месяцев назад

this model is specifically for images of people. you can try another model like ZoeDepth huggingface.co/spaces/shariqfarooq/ZoeDepth

@avantgaarden 6 месяцев назад

thanks a ton this is helpful@@derekau533

@JohnPaulBuce Год назад

ded link bro

@rajeevprabhu6722 2 года назад

You made a mistake by uploading a jpg pic. Process and upload a png or psd one with a trasperant background.

@johndavis1079 2 года назад

It doesn't work

@tronyxwall6378 2 года назад

its not working another useless thing

@derekau533 2 года назад

I just tested it today and can prove that the colab is working, please see the video description for updates.

@youtubedeletesmychannels2329 2 года назад

@@derekau533 it’s not working he’s right I got a error about a sample test idk wtf that means😂

@youtubedeletesmychannels2329 2 года назад

@@derekau533 eh idk care no more it’s too annoying how do I even reverse all the downloads and just uninstall the whole time waste all together

@vinayrana6632 2 года назад

@@derekau533 not working for me as well - facing this issue : ValueError: not enough values to unpack (expected 4, got 0)

@chrisw.3576 2 года назад

@@vinayrana6632 same here...

@Encumberedemotions 4 месяца назад

This shit is slow and didn't work

@jcoast1 Год назад

ERROR: Could not find a version that satisfies the requirement pytorch3d (from versions: none) ERROR: No matching distribution found for pytorch3d crap...dislike