sreyafrancis / pfnn Goto Github PK
View Code? Open in Web Editor NEWPhase-Functioned Neural Networks for Character Control
License: Other
Phase-Functioned Neural Networks for Character Control
License: Other
Could you release the character 3D model?
Hey, we're trying to use our own motion capture database, but we're not very sure how to generate the phase & gait txt.
We visualized the bvh file using blender and can see that the phase is deciding by using the lowest foot height and then calculating steps, probably as described in the paper.
What about the gait file? we checked it a little bit but not quite sure. We'll go through the paper and check the gait file again. Mean while I think create an issue here may also help.
Thanks.
Exciting project!
I also found your training part uses the theano package with self-defined NN layer. Do you think it is a good idea if it can be rewrited with currently polpular package, .e.g tensorflow or pytroch?
Hello!
I try to change the character, which has different joint positions with the original character.
However, it seems to change joint positions of the new character to be similar with original one, and distort the character to fit this change. As a result, the character looks terrible.
I wonder how I can use a new character with different joint positions? Do I need to retrain the model with new character?
An other question is, can I reduce the number of joint points? Do I need to retrain the model?
Looking forward to your reply. Thank you very much.
Hi, I'm trying to run the generate_database.py, but get a syntaxError after import skeleton as skd in skeletondef.py, line 1: ROOT Hips.
Did I forget to install anything? I can't figure out what I did wrong.
I hope you can help me.
Such as the file PFNN/skeletondef.py:
JOINT_WEIGHTS = [
1,
1e-10, 1, 1, 1, 1,
1e-10, 1, 1, 1, 1,
1e-10, 1, 1,
1e-10, 1, 1,
1e-10, 1, 1, 1, 1e-10, 1e-10, 1e-10,
1e-10, 1, 1, 1, 1e-10, 1e-10, 1e-10
]
Given a 3D mesh along with skeleton weights, is this the corresponding whights ??But how can i extract those weight values?
"""
Hi, congrats for the great work and thanks for sharing!
I'm trying to replicate the results for research purposes, and need to compute the NN input at runtime. In particular, the computation of the future parts of the trajectory, as described in Section 6 of your paper, seems the most critical.
I'm wondering if you could kindly provide a pointer to existing code implementing this key input processing, and possibly some context/documentation on how to use it. (e.g., may it be somewhere in this file? https://github.com/sreyafrancis/PFNN/blob/master/demo/pfnn.cpp)
I'm also available by email, just in case (see profile).
Thank you.
July 17 2018 Update: The problem was that the 32-bit version of python was installed on my machine. The 32-bit version is well known for it's memory limitations.
Upgrading to the 64-bit version of python solved the issue.
Hi,
I'm trying to work through the prepossessing stage of the PFNN weights and biases generation process.
I'm consistently hitting an error when I run generate_patches.py:
D:\Projects\HiFi\PFNN\PFNN-master>python generate_patches.py
Processing ./data/heightmaps/hmap_001_smooth.txt (504 x 302) 0 [676]
Processing ./data/heightmaps/hmap_002_smooth.txt (360 x 784) 424 [1254]
Processing ./data/heightmaps/hmap_003_smooth.txt (554 x 384) 1657 [945]
Processing ./data/heightmaps/hmap_004_smooth.txt (523 x 532) 2315 [1236]
Traceback (most recent call last):
File "generate_patches.py", line 52, in <module>
S = ndimage.interpolation.shift(H, (xi, yi), mode='reflect')[:size*2,:size*2]
File "C:\Users\*****\AppData\Roaming\Python\Python37\site-packages\scipy\ndimage\interpolation.py", line 504, in shift
output = _ni_support._get_output(output, input)
File "C:\Users\*****\AppData\Roaming\Python\Python37\site-packages\scipy\ndimage\_ni_support.py", line 75, in _get_output
output = numpy.zeros(shape, dtype=input.dtype.name)
MemoryError
D:\Projects\HiFi\PFNN\PFNN-master>
I have increased my paging file size to up to 100GB. From task manager, the script appears to bomb out at less than 1.6GB.
Please feel free to contact me should you require further information.
~ DaveDub
Hi,
Thanks for the code. I am trying to understand equation 7 in the paper http://theorangeduck.com/media/uploads/other_stuff/phasefunction.pdf
For that I need to know the four values of control points for the phase p that you used for deriving w and k_n.
I was thinking they should be p -> [0, pi, 2pi, 3pi] but then: (mod 1) in the equation for w would be confusing as mod 1 for any integer would be 0. Also, if you can point me to the code for equation 7 in your repo, it would be helpful.
Thanks
Rohit
can you provide your script?
When I'm running pfnn.exe on Windows, I'm able to visualize the character and load different height maps but I'm unable to make the character move. It's written that we need to plug in an Xbox gamepad for controlling the character and we might have to play with the gamepad enums in the pfnn.cpp file. (I'm not familiar with C++ language)
I want to make the character move using Windows keyboard. Please help!
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.