xrenaa / music-dance-video-synthesis Goto Github PK
View Code? Open in Web Editor NEW[ACM MM 20 Oral] PyTorch implementation of Self-supervised Dance Video Synthesis Conditioned on Music
[ACM MM 20 Oral] PyTorch implementation of Self-supervised Dance Video Synthesis Conditioned on Music
Thanks for the great work. I've tried to run the code as instructed using the clean part data. The results are far from impressive as shown in the demo video (like this). Here is the loss curve:
I wonder if I have to change some settings to make it work. Any help is appreciated!
Hello author, now I have got the generated matchmaker, but I don't know how to use the matchmaker to generate the corresponding character gifs, does the code you uploaded include this part? Or do I need to go to everyone dance now to download the code to generate the corresponding gifs?
Hi,
Thanks a lot.
Hello,
I have few questions about demo
how can i use my own music for demo?
which get_demo.py is correct one? there are multiple of them on the root folder as well as under Demo folder
I get similar bug as in #3 . I added audio folder in demo folder, but i get same error for output folder now
Thank you
Hi,
I found that you have provided the second part of the cross-modal evaluation in another github page.
I wonder if it is possible for you to further provide the followings:
Thanks!
Is there a code to assess FID and diversity?
When measuring fid, the features extracted by stgcn is a list, how to deal with it afterwards?
Hello. First of all, thank you for the great work. I'm so impressed by this project and trying to use my own dataset to train this network. However, I have no idea about making my dataset to json file that 'train.py' can read. How should I process my dataset? Thank you.
你好,
我跑起來出現了如下的異常
另外有些疑問:
1,如果要輸入原始視頻,重新訓練該怎麼做,就是那些json文件是怎麼生成的
2,怎麼輸入音頻
3,這個項目和https://github.com/NVlabs/Dancing2Music 哪個更好呢?
when I run python3 get_demo.py --output ./output/
raise:
'FileNotFoundError: [Errno 2] No such file or directory: './dataset/clean_revised_pose_pairs.json'
where should I get this file ?
thx!
Hi, I am trying to train and test on other datasets you provided such as Ballet and Popping. However, the training is good but I am meeting the following error when testing, can you help me to fix it? Thanks!
Traceback (most recent call last):
File "get_demo.py", line 73, in
data=DanceDataset(args.data)
File "/data0/htang/projects/Music-Dance-Video-Synthesis/dataset/lisa_dataset_test.py", line 22, in init
sub_keys=sorted(pose_dict_boy[str(key)].keys())
KeyError: '047'
Why pose keypoints processed by this:
Is the dance video size is 320 * 180? But some point is [350.1983515423332, 296.6837658604959]
It really confused me, any help would be appreciated
Hi author,thank you for your great work!
I have read your paper and I have a question that how to extrat the music feature ? If i want to use my music as input , how should I extract the feature from music?
Run time
python train.py
I get the following error
RuntimeError: DataLoader worker (pid(s) 9784, 7708, 11984, 11008, 3636, 15428, 10724, 1548, 2312, 12376, 1792) exited unexpectedly
Help to fix the error
&
Run time
python get_demo.py --output the_output_path
I get the following error
FileNotFoundError: [Errno 2] No such file or directory: './dataset/clean_revised_pose_pairs.json'
Help to fix the error
Thank
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.