Freedom Arts 3D Tutorials

All Tutorials of iClone, Unreal Engine, Blender, 3D Modeling, Animation & Game Development!

  • Search Keywords

  • Tutorial Type


  • Software


  • 3D Skill


Freedom’s Choice!

Making 3D Animation with Unlimited 3D avatars in 1 minute? Try iClone 8 & Character Creator 4!

Download iClone 8 & Character Creator 4 (CC4) with all Plug-in

Download iClone8 + CC4 + Plugin

Download Character Creator 4 (CC4)

Character Creator 4

SkinGen Premium Plug-in

Headshot 2 Plug-in

Face Tools Plugin

iClone 8

BuildingGen Plugin

AccuFACE Plugin

Unreal Live Link Plugin

PopcornFX Plugin

PopVideo 3

Faceware Plugin

Nature Terrain Generator Plugin

iClone 7

3DXchange Pipeline 7

PIFuHD – Photo to 3D mesh in Blender (with texture)

Tutorial Type: ,
Software: ,
Skill: , ,

Hey guys! how to use your picture photo to automatic generate 3D mesh in 3-minutes, and then add the complete texture in Blender? Follow this tutorial step-by-step then you can make it! ENJOY! and have fun! Happy 3D modeling, animation and game developing! ENJOY!
https://www.youtube.com/watch?v=kERzhJKYvGo&list=PLNvWyorFdszm1yuscwO18–dK56TMv-K8&index=44

Tutorial Updated:
From a PNG/JPG Picture to 3D ANIMATION in 20-minutes!
Check this out! Updated version of tutorial!
https://www.youtube.com/watch?v=WFN8zn_7PZk&list=PLNvWyorFdszm1yuscwO18–dK56TMv-K8&index=5

PIFuHD official website:
https://shunsukesaito.github.io/PIFuHD/

Download Blender for FREE:
https://www.blender.org/download/

Blender + PIFuHD Tutorial – Convert your photo to 3D mesh – PIFuHD demo + Blender Texturing demo

This tutorial is updated on 24th June 2020, to replace the previous tutorial
Old version of tutorial:
https://www.youtube.com/watch?v=LWDGR5v3-3o&t=1s

what’s new:
1. New steps of uploading your photo into PIFuHD.
2. Add on tutorial on “how to texture your 3D OBJ from PIFuHD”. I am using blender to add the texture, by using your original photo.
3. Export as FBX with full texture which can be use in other 3D software.

Steps:
1. Use PIFuHD to convert your photo to 3D mesh, download as OBJ.
2. Import OBJ into Blender, use the original photo as texture, and perform a few texturing steps.
3. Once done, export it out, as FBX, which can be use in any 3D software.

If you want to do 3D animation, please use your T-pose photo. Capture you or your friends’ photo with T-pose, so that you can send it to Mixamo to auto-rig it and add in some motion.

Auto-rigger tutorial please refer to this video:
Blender Tutorial: Auto-rig and embed motions from Mixamo in 1-minute
Link:
https://www.youtube.com/watch?v=fnLi04ufv1M&t=326s

Real-time keyboard strokes and mouse click on-screen. 100% step by step. If you follow every steps in this tutorial, it works.

PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization

If you love my video, click Subscribe at the bottom, and click the mini BELL, select all, to receive notification for every time I post a video. I will keep on posting more and more special tutorial for you.

THANK YOU FOR WATCHING!

Your friend,
FREEDOM.

Face any problem? Require any tutorial in 3D animation? Send me a message. Keep in touch. Try my best to help you solve the problems.
My FCEBOOK account:
https://www.facebook.com/Freedom-Arts-3D-animation-108187640914514/?modal=admin_todo_tour

===================
About Blender
===================
Blender is the free and open source 3D creation suite. It supports the entirety of the 3D pipeline—modeling, rigging, animation, simulation, rendering, compositing and motion tracking, video editing and 2D animation pipeline.

Blender is a public project, made by hundreds of people from around the world; by studios and individual artists, professionals and hobbyists, scientists, students, VFX experts, animators, game artists, modders, and the list goes on.

===================
About iClone
===================
iClone is the fastest real-time 3D animation software in the industry, helping you easily produce professional animations for films, previz, animation, video games, content development, education and art. Integrated with the latest real-time technologies, iClone 7 simplifies the world of 3D Animation in a user-friendly production environment that blends character animation, scene design and cinematic storytelling; quickly turning your vision into a reality.

#PIFuHD
#Blender
#texture
#PictureTo3D

Real-time keyboard strokes and mouse click on-screen. 100% step by step. If you follow every steps in this tutorial, it works.

My full tutorial playlist (categorized systematically by types):
https://freedomarts3d.blogspot.com/2020/10/3d-animation-and-game-developer-tutorial.html

My full tutorial playlist (No categorized):
https://www.youtube.com/channel/UCPi437n6fBnO_z0vexNgv_w/playlists?view_as=subscriber

Youtube Channel:
Freedom Arts – 3D Animation and Game Developer
https://www.youtube.com/channel/UCPi437n6fBnO_z0vexNgv_w

If you feel all these tutorials are helpful for you, SUBSCRIBE to my Youtube Channel, turn on the mini “BELL”, select “ALL”, so that when next time I publish a new video tutorial, you will receive the notification immediately.

THANK YOU FOR WATCHING!

Your friend,
FREEDOM

Face any problem? Require any tutorial in 3D animation and Game development? Send me a message, keep in touch. I will try my best to solve the problems.

Send me a MESSAGE (Facebook/Messenger):
https://www.facebook.com/messages/t/108187640914514

My FACEBOOK account:
https://www.facebook.com/Freedom-Arts-3D-animation-108187640914514

Join my Facebook GROUP:
https://www.facebook.com/groups/818222008952458

source

43 responses to “PIFuHD – Photo to 3D mesh in Blender (with texture)”

  1. Sangeeta Sahu Avatar
    Sangeeta Sahu

    Faltu video hai texture AA hi nahi Raha hai model me

  2. Andrew Man Avatar
    Andrew Man

    Have an error from lib.colab_util import generate_video_from_obj, set_renderer, video

    renderer = set_renderer()
    generate_video_from_obj(obj_path, out_img_path, video_path, renderer)

    # we cannot play a mp4 video generated by cv2
    !ffmpeg -i $video_path -vcodec libx264 $video_display_path -y -loglevel quiet
    video(video_display_path)

  3. Nicolas Eraso Avatar
    Nicolas Eraso

    On this section i am getting and error:

    net = PoseEstimationWithMobileNet()
    checkpoint = torch.load('checkpoint_iter_370000.pth', map_location='cpu')
    load_state(net, checkpoint)

    get_rect(net.cuda(), [image_path], 512)

    ————————————————————————–

    AttributeError: 'NoneType' object has no attribute 'copy'

    someone know it?

  4. Kharisma Tutorial Avatar
    Kharisma Tutorial

    This channel deserves more subs 🔥

  5. Jiyan Yenigün Avatar
    Jiyan Yenigün

    In the pifu final section, the file can only be downloaded as png. I can't download as an object, what could be the reason?

  6. Lee Yan Avatar
    Lee Yan

    can't anymore

    😪

  7. Sohaib Dar Avatar
    Sohaib Dar

    Thank you so much bro you save the day.

  8. Complainer Gamer Avatar
    Complainer Gamer

    Bummer
    from lib.colab_util import generate_video_from_obj, set_renderer, video

    renderer = set_renderer()

    generate_video_from_obj(obj_path, out_img_path, video_path, renderer)

    # we cannot play a mp4 video generated by cv2

    !ffmpeg -i $video_path -vcodec libx264 $video_display_path -y -loglevel quiet

    video(video_display_path)
    —————————————————————————

    ImportError Traceback (most recent call last)

    <ipython-input-19-22614b7ef849> in <module>

    —-> 1 from lib.colab_util import generate_video_from_obj, set_renderer, video

    2

    3 renderer = set_renderer()

    4 generate_video_from_obj(obj_path, out_img_path, video_path, renderer)

    5

    4 frames

    /usr/local/lib/python3.8/dist-packages/pytorch3d/renderer/blending.py in <module>

    7

    8 # pyre-fixme[21]: Could not find name `_C` in `pytorch3d`.

    —-> 9 from pytorch3d import _C

    10

    11

    ImportError: libcudart.so.10.1: cannot open shared object file: No such file or directory

    —————————————————————————

    NOTE: If your import is failing due to a missing package, you can

    manually install dependencies using either !pip or !apt.

    To view examples of installing some common dependencies, click the

    "Open Examples" button below.

  9. John Paul Buce Avatar
    John Paul Buce

    wow thanks 👍👍👍

  10. Hasan Şengüler Avatar
    Hasan Şengüler

    also below
    ImportError Traceback (most recent call last)

    <ipython-input-17-22614b7ef849> in <module>

    —-> 1 from lib.colab_util import generate_video_from_obj, set_renderer, video

    2

    3 renderer = set_renderer()

    4 generate_video_from_obj(obj_path, out_img_path, video_path, renderer)

    5

    4 frames

    /usr/local/lib/python3.7/dist-packages/pytorch3d/renderer/blending.py in <module>

    7

    8 # pyre-fixme[21]: Could not find name `_C` in `pytorch3d`.

    —-> 9 from pytorch3d import _C

    10

    11

    ImportError: libcudart.so.10.1: cannot open shared object file: No such file or directory

    —————————————————————————

    NOTE: If your import is failing due to a missing package, you can

    manually install dependencies using either !pip or !apt.

    To view examples of installing some common dependencies, click the

    "Open Examples" button below.

  11. Hasan Şengüler Avatar
    Hasan Şengüler

    Hello,
    Thank you for sharing the video, I get below error, could you pls. help
    thank you

    from lib.colab_util import generate_video_from_obj, set_renderer, video

    renderer = set_renderer()

    generate_video_from_obj(obj_path, out_img_path, video_path, renderer)

    # we cannot play a mp4 video generated by cv2

    !ffmpeg -i $video_path -vcodec libx264 $video_display_path -y -loglevel quiet

    video(video_display_path)

  12. ranska Avatar
    ranska

    Nice vidéo mate, interesting to see how you go fast on texturing the back of the character.

  13. Karu Brandao Avatar
    Karu Brandao

    I'm trying to learn about ICON (implicit clothed humans obtained from normals) and Nvidia's nerf. Could you please try to do a tutorial about these 2 because it seems they are the best till now for this purpose. Thank you!

  14. SMOKEY 26 Avatar
    SMOKEY 26

    i got a message error here
    from google.colab import files

    filename = list(files.upload().keys())[0]

  15. princeofcold2297 Avatar
    princeofcold2297

    impressive video 🙂
    do you know a way through which we can convert the pose of of the model into T-pose?

  16. Chippada Sai babu Avatar
    Chippada Sai babu

    Thank you for your guidence in expaling clearly to convert 2d image into 3d object…

    But my doubt if i want to print 3d object what i converted…?
    Which 3d printer can give me the realstic body color to object..
    Or which color filament can help us to see clear vison on object…

    Please help me in this…
    Once again thank you sir.

  17. Nebiroth Avatar
    Nebiroth

    Hi mate, loved this video. Liked and subbed. Life would be much better if PIFuHD had the option of importing the texture with color from the 2D image, or a colab notebook that colors the 3d mesh based on the 2d image input. I think in the future we may see something like that in a few years…

  18. Kyree Liggins Avatar
    Kyree Liggins

    When I choose file top upload image i get 0% done and a message error: maximum call stack size exceeded. can someone help?

  19. เทวดาเจ้าพ่อ 3D เล่าเรื่องผี3D Avatar
    เทวดาเจ้าพ่อ 3D เล่าเรื่องผี3D

    ครูสอนที่ดีของผมเลยครับ

  20. Temporal Lab SOL Avatar
    Temporal Lab SOL

    You can use C key to enter circle brush selection and ctrl +/- to fine tune it

  21. Vidhu Tripathi Avatar
    Vidhu Tripathi

    Love your patience to explain in detail and the keyboard and mouse shortcuts. Thank you 🙂

  22. dipu parmar Avatar
    dipu parmar

    Hy,bro your tutrial is veryy nice.I try blender 2.83 in not show UV, Which tool select and i do work complit.

  23. Abrar Shaikh Avatar
    Abrar Shaikh

    Run PIFuHD!

    [16]

    15s

    # Warning: all images with the corresponding rectangle files under -i will be processed.

    !python -m apps.simple_test -r 256 –use_rect -i $image_dir

    # seems that 256 is the maximum resolution that can fit into Google Colab.

    # If you want to reconstruct a higher-resolution mesh, please try with your own machine.

    Resuming from ./checkpoints/pifuhd.pt

    Warning: opt is overwritten.

    test data size: 1

    initialize network with normal

    initialize network with normal

    generate mesh (test) …

    0% 0/1 [00:00<?, ?it/s]/content/pifuhd/lib/data/EvalDataset.py:87: UserWarning: loadtxt: Empty input file: "/content/pifuhd/sample_images/bored_rect.txt"

    rects = np.loadtxt(rect_path, dtype=np.int32)

    0% 0/1 [00:00<?, ?it/s]

    Traceback (most recent call last):

    File "/usr/lib/python3.7/runpy.py", line 193, in _run_module_as_main

    "__main__", mod_spec)

    File "/usr/lib/python3.7/runpy.py", line 85, in _run_code

    exec(code, run_globals)

    File "/content/pifuhd/apps/simple_test.py", line 30, in <module>

    reconWrapper(cmd, args.use_rect)

    File "/content/pifuhd/apps/recon.py", line 220, in reconWrapper

    recon(opt, use_rect)

    File "/content/pifuhd/apps/recon.py", line 205, in recon

    test_data = test_dataset[i]

    File "/content/pifuhd/lib/data/EvalDataset.py", line 131, in _getitem_

    return self.get_item(index)

    File "/content/pifuhd/lib/data/EvalDataset.py", line 93, in get_item

    im = crop_image(im, rect)

    File "/content/pifuhd/lib/data/EvalDataset.py", line 17, in crop_image

    x, y, w, h = rect

    ValueError: not enough values to unpack (expected 4, got 0)

    Any idea how do we rectify this?

  24. Novel
    Novel’S GalXE

    Mine getting error

  25. HRK Avatar
    HRK

    Thanx a tonne

  26. HRK Avatar
    HRK

    Nice demo

  27. James Rancho Avatar
    James Rancho

    GREAT

  28. Esosa Osayamwen Avatar
    Esosa Osayamwen

    I am not seeing the texture in my exported model. the model has a different color in Mixamo

  29. Ayasodane Avatar
    Ayasodane

    Thanks you very much!

  30. Mike Bert Avatar
    Mike Bert

    it works!!!

  31. Timothy Thomasson Avatar
    Timothy Thomasson

    Hello is there a way to process a bunch of images in Bulk? I want to upload about 100 images of people at once and have it generate a mesh for each of them. Thanks!

  32. will2see Avatar
    will2see

    obizeee!

  33. Samuel Bagas Avatar
    Samuel Bagas

    AMAZING!

  34. kelp bull Avatar
    kelp bull

    Can I use multiple pictures in the same pose to build a model, it maybe more precise?

  35. Ian Saunier Avatar
    Ian Saunier

    So I think this is really awesome and wanted to get an old GPU/accelerator to try it out on my own computer. Out of curiosity do you know if a newer version of Cuda would be better than more memory? I know pytorch needs 3.5 or higher, but I'm no where near smart enough to know what all goes on on the back end of pifuhd.

  36. Narin Thakore Avatar
    Narin Thakore

    Great tutorial. Could you followup with a clean up tutorial so that good quality 3d models can be printed.

  37. Nas8jigga Food Avatar
    Nas8jigga Food

    Bro I appreciate your videos very helpful but can you make a full video please of where a picture not in the T pose can turn into an animation by using a different picture with a T pose? Please

  38. Ritesh Mujalda Avatar
    Ritesh Mujalda

    how to increase the resolution of generated obj ?

  39. Joshua Kerr Avatar
    Joshua Kerr

    Are we able to create the animated meshes from video with this?

  40. UnTrollable321 Avatar
    UnTrollable321

    After i do it i get to the render results part and it fails and i dont know why?

  41. Dillon Peterson Avatar
    Dillon Peterson

    This is crazy. Blowing my mind.

  42. Mym Atelie Avatar
    Mym Atelie

    in pif uhd can I upload multiple pictures of the same person with different angles or just one?

  43. 전희재 Avatar
    전희재

    bro this is so cool! I followed this tutorial and got good results. thank you

Leave a Reply

Related Post

Google Ads

Google Ads

Google Ads

Ads Blocker Image Powered by Code Help Pro

Ads Blocker Detected!!!

We have detected that you are using extensions to block ads. Please support us by disabling these ads blocker.