GithubHelp home page GithubHelp logo

thmoa / tex2shape Goto Github PK

View Code? Open in Web Editor NEW
270.0 270.0 58.0 17.92 MB

This repository contains code corresponding to the paper "Tex2Shape: Detailed Full Human Body Geometry from a Single Image"

Python 99.14% Shell 0.86%

tex2shape's People

Contributors

rs9899 avatar thmoa avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

tex2shape's Issues

Python 3 support?

Can we expect python 3 support?

From what I saw the requirements doens't work either? Chumpy (latest) is not support on python 3?

Python 2.7 is EoL it doesn't make sense to keep using it?

Workaround for Chumpy:
pip install git+https://github.com/scottandrews/chumpy.git@fe51783e0364bf1e9b705541e7d77f894dd2b1ac

if sys.version_info[0] == 3: import _pickle as pkl else: import cPickle as pkl

This leads to the error:

return codecs.charmap_decode(input,self.errors,decoding_table)[0] UnicodeDecodeError: 'charmap' codec can't decode byte 0x9d in position 350: character maps to <undefined>

Training code.

Hi~ Thanks for your great work!
Is there any plan to share the training code? Thanks!

installation issues

Not an issue. Just a comment about opencv installation. Simply using pip install opencv leads to errors. That is because python2.7 support was dropped from opencv=4.3.0.36 onwards.
Using pip install opencv-python==4.2.0.32 worked for me.

Other errors I faced and how I solved them:
1] ERROR:

Could not load dynamic library 'libnvinfer.so.6.
Cannot dlopen some GPU libraries. 
Please make sure the missing libraries mentioned above are installed properly if you would like to use GPU.

SOLUTION:
pip install tensorflow==1.13.1

2] ERROR:

Traceback (most recent call last):
  File "run.py", line 12, in <module>
    from models.tex2shape_model import Tex2ShapeModel
  File "/mnt/t-shingane/tex2shape/models/tex2shape_model.py", line 1, in <module>
    from keras.models import Model
  File "/mnt/envs/tex2shape/lib/python2.7/site-packages/keras/__init__.py", line 22, in <module>
    from keras import distribute
  File "/mnt/envs/tex2shape/lib/python2.7/site-packages/keras/distribute/__init__.py", line 18, in <module>
    from keras.distribute import sidecar_evaluator
  File "/mnt/envs/tex2shape/lib/python2.7/site-packages/keras/distribute/sidecar_evaluator.py", line 180
    f'No checkpoints appear to be found after {_CHECKPOINT_TIMEOUT_SEC} '
                                                                        ^
SyntaxError: invalid syntax

SOLUTION:
pip install keras==2.3.0 (I had initially just run pip install keras (as mentioned in README) which installed keras 2.9.0 and was giving the aforementioned error)

posed mesh

How can we get the posed mesh ? In your implementation, mesh is always in template pose.

UV map details

HI, thanks for the exciting job. I tried to extract an UV map of an example image based on DensePose, the output is slightly different with the corresponding example UV map, but the resulting 3D model is much worse than that of examples. Could you please share some details of the DensePose ? (for example, the backbone models listed in the Model Zoos) Or, did i miss something to get this bad result? @thmoa Hope to get a reply, thanks.
image

How do you generate the canonical UV maps in your papers

Hi thmoa,
Thanks for your great program that helps me a lot.
I have noticed that there were some canonical UV maps as templates used in a series of your papers, such as,

[1] Tex2Shape: Detailed Full Human Body Geometry From a Single Image
[2] Video Based Reconstruction of 3D People Models
[3] Detailed Human Avatars from Monocular Video

where the UV maps look like
image
image
image

I guess all of them are the same UV maps since they have similar shapes and body-partitions.

I want to know what methods/tools/softwares did you used to generate this UV map. Did you use Blender/Maya?

Thanks~

UV map synthetization

Great work! Thanks for providing a lot of interesting insights. I'm trying to train my own model and encounter some unclear parts for generating the ground truth displacement maps. Given your detailed registration of the SMPL to the scans, you "simply render detailed UV displacement and normal maps". Those "encode the free-form offsets, that are not part of SMPL".

Does this mean you render uv maps from the default SMPL model, then your detailed registered SMPL model and then take the difference between those (called free-form offsets in your paper)?

If my understanding of this is wrong, I would be very happy if you could provide some further information of how to reproduce uv displacements maps encoding free-form offsets to SMPL. Thank you!

how get a texture for this model?

hi thmoa:
thanks for your greate program. this is very effient. but now I meet a problem, Can you tell me how get a texture for this model ?
can I use this <semantic_human_texture_stitching >?? thanks for your help

Texture generation for the 3d model

Hi,
Amazing work.
Does the code contain method to generate Texture for the 3D model generated , if not can you please give some heads up on how to create the 3d texture for the OBJ file.
Thanks

How to avoid the influence of color in RGB?

The paper takes advantage of 'rich illumination and shading information contained in RGB values'. But will the predicted result be related to color? (For example, the network can rebuild a person in white clothes but can't handle people who wear black clothes well) If so, how does the network solve it?

Thanks!

Update Repo ?

Is there any chance to get updated repo ? The requirements file are really old.

Thanks.

how to get different poses in the result?

hello, thmoa:
thanks for your program!! when i look around this paper ,I find the different pose in the experiment part, Can you how can I get the result with poses? I run the pragram with no pose before. looking for your reply,thanks
Tex2 Shape Detailed Full Human Body Geometry From a Single Image

the bellow is my result
图片1

thank you for you work

Hello, thank you for you work, can you provide the requestment for runing the demo?
i use python3,but meet some error...

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.