robindsyang / divatrack

Official Repository of DivaTrack: Diverse Bodies and Motions from Acceleration-Enhanced Three-Point Trackers

DivaTrack: Diverse Bodies and Motions from Acceleration-Enhanced Three-Point Trackers

paper

https://onlinelibrary.wiley.com/doi/10.1111/cgf.15057

video

https://youtu.be/NbmcB04hGiM

docker image

docker pull robindsyang/divatrack

dataset link

http://naver.me/FwSksnVJ

build_dataset

python build_dataset.py --filepath $path_to_raw_bvh&mvnx_data --dataset_name $npz_name --outpath $path_to_save_npz

--test True/False -> use only 10 clips for debugging or use entire set

--split True/False -> to split traing/test set or generate a single .npz

infer

python main.py --mode infer --model DTVel --target pose --valid_set $inference_dataset_name.npz --cp_datetime 0510_063301 --resume_iter 60000

divatrack's Issues

Question about inference

Before actually deploying in the wild, I'm trying to inference the model with dataset you shared.
But, I have some problems in running the attached code.

(1) For build_dataset.py, do I have to make .npz file for

(i) each .bvh & .mvnx

• python build_dataset.py --filepath /data/DivaTrack_Dataset/meta_postprocessed/S0_159_exp/S0_001 --dataset_name S0_001

(ii) each exp titles:

• python build_dataset.py --filepath /data/DivaTrack_Dataset/meta_postprocessed/S0_159_exp --dataset_name S0_159_exp

(iii) for whole postprocessed dataset

• python build_dataset.py --filepath /data/DivaTrack_Dataset/meta_postprocessed --dataset_name Divatrack

I thought (ii) is right, but wonder it's true or not.

(2) For main.py, I think there are some missing files.
I think the inference code should be like this.
python main.py --mode infer --model DTVel --target pose --valid_set S0_159_exp_valid.npz --cp_datetime 0510_063301 --resume_iter 1
However, this error comes out.

FileNotFoundError: [Errno 2] No such file or directory: 'expr/checkpoints/0113_210014_FCCalib_6000.pth'

Because, from this line,

DivaTrack/model/DivaTrackVel.py

Line 299 in 3dd7303

cPATH = in_args.cp_dir + '/0113_210014_FCCalib_6000.pth'

the '/0113_210014_FCCalib_6000.pth' file is not given from this repo.
Could you share the file?

(3) Could you share any other datasets for testing this model? from the code, I think other dataset could be used, but it's not mentioned in the repo README.

Thanks!

About Deployment Settings

Thanks for the nice work!
I really appreciate your idea and working demo.

First of all, thanks for sharing code to run your idea.
However, as I understand, current version of code doesn't support in-the-wild demo settings.
Could you also share how to run your model with HMD devices(HMD & 2 controllers or Tracker)?

Thanks!