GithubHelp home page GithubHelp logo

About locomotion variations about genmm HOT 2 OPEN

abassino avatar abassino commented on August 15, 2024
About locomotion variations

from genmm.

Comments (2)

wyysf-98 avatar wyysf-98 commented on August 15, 2024

Hello, thank you very much for your attention to our work. Our work is not focused on locomotion, but rather on exploring more variations within a complex motion sequence (such as dance) with self-similarity. Locomotion does not have as many transition time points, and the phase features of locomotion are also very important for visual results. Currently, for this type of data like locomotion, I believe we can try the following aspects to achieve better results:

  1. Increasing the Length of Input Sequences: As you mentioned, having input sequences as long as possible, ideally over 500 frames, could be beneficial. This allows our algorithms to identify a sufficient number of transition points to regenerate new motions. To achieve this, you might consider repeating the input motion sequences, concatenating more actions, or collecting longer data.

  2. Adjusting Patch Size and Completeness Parameters: By fine-tuning parameters such as patch size and completeness, we can achieve better results for periodic motions.

Regarding "use_velo," it refers to generating the velocity of the root joint. When this value is set to false, we predict its position in the world coordinate system, as the position of the motion may experience sudden changes. If you want to implement the feature of "returning back to the start position," a simple method may not suffice, because this is related to the path of motion, and as shown in the video, we cannot precisely control the generated pathโ€”it is randomly sampled.
From your results, it can be observed that if a strict requirement is imposed for the starting and ending positions of the generated action sequence to be identical, a sudden change will occur.
This is also another important research direction in the field of motion generation.

I hope my answer has been helpful to you.

from genmm.

abassino avatar abassino commented on August 15, 2024

Thank you very much for your prompt reply and for the clarification. Regarding the first point to get better results with locomotion in general, i will try to experiment with different hyper-parameters as you suggested. However, it is also worth mentioning that the locomotion examples i used are not periodic (non-loop animation).

On the second point (setting use_velo to false), I think there was misunderstanding. My intention is not to get back to the initial position , but rather to avoid it. Unfortunately the character automatically attempt to get to the initial start position when use_velo is set to false, and even when loop parameter is set to false in the config file. Ideally, the result should be similar to what we get when use_velo is true, with the character keeping moving forward for a walk forward example animation.

Thank you once again for your inputs.

Best regards

from genmm.

Related Issues (15)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.