Comments (4)
Hi, for sequences beyond quadruped/human category (e.g., penguins, hand, eagle, laikago robot), we use the off-the-shelf quadruped CSE features. A more detailed instruction to reproduce those results are here.
You are right, one can apply banmo to categories like cups/cars without a pre-trained category-specific cse embedding, if good initial root poses are given.
from banmo.
Thanks for your response!
So during the registration, the same pre-trained quadruped CSE model is used to get canonical embeddings of the image, and is optimized with the MLP that get the embeddings of the 3D vertex jointly?
And I'm a little confused about this line. What do csenet_feats and dps refer to respectively?
from banmo.
csenet_feats
is the 112x112x16 feature map, and dps
is the 112x112 integer vertex index to the canonical mesh (used in CSE) for visualization only.
The script for CSE finetune is not published given all the results we've shown in the paper did not fine-tune CSE. But the functions are in this repo. To fine-tune CSE, you may need to pass --ft_cse
and --nolineload --batch_size 8 --nsample 128
. The later flags makes sure the whole image is loaded to compute CSE features.
from banmo.
Thanks for your help! I get it now,
from banmo.
Related Issues (20)
- Could you provide a demo that can work with one-click HOT 1
- Running out of space when running AMA (Samba + Swing) HOT 2
- Questions about the code. HOT 2
- Mesh generated on AMA-swing and Eval code HOT 2
- About projecting 3D verteces to 2D images HOT 1
- Error when rendering AMA-swing dataset HOT 2
- unable to load materials from: ./wood.obj.mtl HOT 3
- nvs_iter.sh HOT 2
- Extracting root pose HOT 1
- Loading the ".npy" files such as "cat-pikachiu.npy" or "shiba-haru-1.npy" has been failed HOT 3
- Questions about output results HOT 8
- exporting 3D models with skinning HOT 5
- Can Banmo support torch 1.11+cu113? HOT 1
- BANMo VS. ViSER HOT 2
- Clarification of the Matching Loss HOT 3
- Ckpt Release HOT 1
- face_normals all zero,ignoring
- The problem of extracting masks for deformable dynamic target objects HOT 3
- Enhancing Mesh Quality and Texture in BANMo Extracted Models HOT 1
- Questions about PoseNet HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from banmo.