mkocabas / spec Goto Github PK

May I ask if the whole process is to fix the parameters after CamCalib is trained, and then train with SPEC?

Hi, i download spec-github-data.zip many times, but can't get the data completely. Can you check it again?

Is there a way to get all the camera params? Translation in the world for instance. Or even to get just R, T, K matrices? Thanks

Dear Muhammed,

Thank you for this work and the datasets! I'm trying to interpret the data in the SPEC-SYN npz data files, but I'm not sure what each key means. Is there documentation? They are the following: ['imgname', 'center', 'scale', 'pose', 'shape', 'part', 'mmpose_keypoints', 'openpose', 'openpose_gt', 'S', 'focal_length', 'cam_rotmat', 'cam_trans', 'cam_center', 'cam_pitch', 'cam_roll', 'cam_hfov', 'cam_int', 'camcalib_pitch', 'camcalib_roll', 'camcalib_vfov', 'camcalib_f_pix']

At this point, I'd just like to plot the 24 SMPL joints on the image. Based on the array shape, I assume 'S' contains the joints. Is cam_rotmat the rotation from world space to camera space? Is the cam_trans the position of the camera or the top right part of the extrinsic matrix? I assume for this plotting exercise I can ignore everything except S, cam_rotmat, cam_trans and cam_int. Still for some reason the points end up at at very wrong places. Maybe 'S' is something else? Or am I using the camera params wrong?

Thanks!
Istvan

Thanks for sharing this work!
Please fix the requirement in requirement.txt file of PARE.
It should be (currently missing "git+" prefix):
git+https://github.com/mkocabas/PARE.git

I'd like to know if it's possible to get a translation of the camera. I've found the code just for rotation and focal length estimation.

On this image https://github.com/mkocabas/SPEC/blob/master/docs/assets/spec_gif.gif the camera is placed in the world space somehow. How did you do this? Thanks.

Hi, when the training instructions is released ?

Hi,I tried accesing the colab notebook but wasn't able to access it.Would you be able to kindly suggest another way to run inference as I am currently working on a windows based CPU system.

I've encountered frequent problems that SPEC is having to fit the model to feet correctly:

Is this the same problem as mentioned in the VIBE discussion: mkocabas/VIBE#24 (comment) ? Have you tried to include the OpenPose feet keypoint predictions to the loss?

Thanks for the great work!

Dear Muhammed, a huge fan of your work. Can SPCE run MANO?

Thank you

all example_image seem get error result by camcalib_demo.py, look like this:

it seems the predicted horizon line shift by model,how should I solve this problem？

I tried running the evaluation only for the 3DPW dataset with the following command:

python scripts/spec_eval.py --cfg data/spec/checkpoints/spec_config.yaml --opts DATASET.VAL_DS 3dpw-test-cam 

But it gives the following error:

TypeError: test_step() missing 1 required positional argument: 'dataloader_nb'

Fixed it by giving a default value for dataloader_nb for the test_step function in trainer.py:

def test_step(self, batch, batch_nb, dataloader_nb=0):
    return self.validation_step(batch, batch_nb, dataloader_nb)

The error occurs because we don't append dataloader_idx to args in evaluation_loop.py:

if multiple_test_loaders or multiple_val_loaders:
    args.append(dataloader_idx)

Hi @mkocabas ,

Thank you for your amazing work.
Could you please update the links with pretrained models/data for the demo? It seems like the content from dropbox was deleted, therefore, the model/data is inaccessible.

Hi~ When I run the command python scripts/spec_demo.py --batch_size 1 --image_folder data/sample_images --output_folder logs/spec/sample_images, I got the error as this:
Segmentation fault (core dumped)
I have no idea about it, could you help me, please?

It's a great job. Is the video demo not available now?
`def main(args):

demo_mode = args.mode

if demo_mode == 'video':
    raise NotImplementedError
elif demo_mode == 'webcam':
    raise NotImplementedError`

Hello author:

After unzipping the spec-github-data.zip, there is no data/dataset_folders/pano360/flickr_photo_ids.npy.
I don't know whether I find the right place, could you help me?

Best regards.