mkocabas / spec Goto Github PK
View Code? Open in Web Editor NEWCode for ICCV2021 paper SPEC: Seeing People in the Wild with an Estimated Camera
License: Other
Code for ICCV2021 paper SPEC: Seeing People in the Wild with an Estimated Camera
License: Other
Dear Muhammed, a huge fan of your work. Can SPCE run MANO?
Thank you
Dear Muhammed,
Thank you for this work and the datasets! I'm trying to interpret the data in the SPEC-SYN npz data files, but I'm not sure what each key means. Is there documentation? They are the following: ['imgname', 'center', 'scale', 'pose', 'shape', 'part', 'mmpose_keypoints', 'openpose', 'openpose_gt', 'S', 'focal_length', 'cam_rotmat', 'cam_trans', 'cam_center', 'cam_pitch', 'cam_roll', 'cam_hfov', 'cam_int', 'camcalib_pitch', 'camcalib_roll', 'camcalib_vfov', 'camcalib_f_pix']
At this point, I'd just like to plot the 24 SMPL joints on the image. Based on the array shape, I assume 'S' contains the joints. Is cam_rotmat the rotation from world space to camera space? Is the cam_trans the position of the camera or the top right part of the extrinsic matrix? I assume for this plotting exercise I can ignore everything except S, cam_rotmat, cam_trans and cam_int. Still for some reason the points end up at at very wrong places. Maybe 'S' is something else? Or am I using the camera params wrong?
Thanks!
Istvan
Hi~ When I run the command python scripts/spec_demo.py --batch_size 1 --image_folder data/sample_images --output_folder logs/spec/sample_images, I got the error as this:
Segmentation fault (core dumped)
I have no idea about it, could you help me, please?
Thanks for sharing this work!
Please fix the requirement in requirement.txt
file of PARE.
It should be (currently missing "git+" prefix):
git+https://github.com/mkocabas/PARE.git
Hello author:
After unzipping the spec-github-data.zip, there is no data/dataset_folders/pano360/flickr_photo_ids.npy.
I don't know whether I find the right place, could you help me?
Best regards.
I'd like to know if it's possible to get a translation of the camera. I've found the code just for rotation and focal length estimation.
On this image https://github.com/mkocabas/SPEC/blob/master/docs/assets/spec_gif.gif the camera is placed in the world space somehow. How did you do this? Thanks.
I've encountered frequent problems that SPEC is having to fit the model to feet correctly:
Is this the same problem as mentioned in the VIBE discussion: mkocabas/VIBE#24 (comment) ? Have you tried to include the OpenPose feet keypoint predictions to the loss?
Thanks for the great work!
Hi @mkocabas ,
Thank you for your amazing work.
Could you please update the links with pretrained models/data for the demo? It seems like the content from dropbox was deleted, therefore, the model/data is inaccessible.
Hi,I tried accesing the colab notebook but wasn't able to access it.Would you be able to kindly suggest another way to run inference as I am currently working on a windows based CPU system.
Is there a way to get all the camera params? Translation in the world for instance. Or even to get just R, T, K matrices? Thanks
May I ask if the whole process is to fix the parameters after CamCalib is trained, and then train with SPEC?
I tried running the evaluation only for the 3DPW dataset with the following command:
python scripts/spec_eval.py --cfg data/spec/checkpoints/spec_config.yaml --opts DATASET.VAL_DS 3dpw-test-cam
But it gives the following error:
TypeError: test_step() missing 1 required positional argument: 'dataloader_nb'
Fixed it by giving a default value for dataloader_nb
for the test_step
function in trainer.py
:
def test_step(self, batch, batch_nb, dataloader_nb=0):
return self.validation_step(batch, batch_nb, dataloader_nb)
The error occurs because we don't append dataloader_idx
to args
in evaluation_loop.py
:
if multiple_test_loaders or multiple_val_loaders:
args.append(dataloader_idx)
It's a great job. Is the video demo not available now?
`def main(args):
demo_mode = args.mode
if demo_mode == 'video':
raise NotImplementedError
elif demo_mode == 'webcam':
raise NotImplementedError`
Hi, i download spec-github-data.zip many times, but can't get the data completely. Can you check it again?
Hi, when the training instructions is released ?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.