Comments (7)
4dface is a very simple demo from around a year ago that performs per-frame fitting, as you correctly described. The fitting function can take initial parameters (for example from the previous frame), in which case it converges faster, but it's still per-frame (and I don't remember if I finished implementing this - but it should be easy to find out).
We also have a multi-frame fitting that fits to multiple frames at once, and thus improves the shape estimates. This is currently in a separate branch here, and we've got very promising results with it. It will eventually be merged to the eos master branch, but it'll take a while more.
from 4dface.
@patrikhuber are you sure that multiframe fitting in this branch works because ig was updated a month ago?
from 4dface.
@Thanh-Binh I'm not sure I understand your question. That is the multi-frame fitting that we have been using and it works very well for us.
from 4dface.
@patrikhuber how many frames do you need for each fitting call?how about accuracy vs runtime?
from 4dface.
@Thanh-Binh We determined 10-20 to be a good number. The accuracy increases quite steeply when going from 1..2..3..5..10 frames. From then on, it flattens a bit.
I can't give concrete runtime numbers from the top of my head but our implementation is pretty fast and IIRC it's something like linear in the number of images.
from 4dface.
Very nice to hear! I will test it soon!
from 4dface.
I'm going to close this as it's not an issue per se, and multi-frame fitting is being worked on in above linked branch in eos.
from 4dface.
Related Issues (20)
- Publish pre-built executable HOT 19
- Update travis and AppVeyor configs
- How to implement merged isomap and visualize mesh in Python HOT 1
- dlib landmarks failed under big face angle towards camera HOT 2
- Texture.cpp: use COLOR_BGR2BGRA instead of CV_BGR2BGRA HOT 7
- Could not find Eigen3 with Visual studio 2017 HOT 1
- Possibility of choosing quality versus speed trade-offs to decrease frame processing times? HOT 2
- How to change the shape&expression model in 4dface? HOT 4
- Undefined symbols for architecture x86_64: Mac Sierra + Homebrew HOT 5
- Face-detection performance HOT 6
- would you please provide some detail describes about how to fit 3DMM to frames in an iterative way? Thank you HOT 1
- please help me, thank you HOT 1
- How to retrieve the head pose estimation / Euler angles HOT 5
- error: ‘const class Eigen::ArrayWrapper<const Eigen::Matrix<float, -1, 1> >’ has no member named ‘rsqrt’ HOT 6
- Does 4dface fit only to landmarks or edges as well HOT 1
- No warning, No error, No make... HOT 2
- Make Install Error HOT 3
- error when run 4dface HOT 4
- How to save the obj files HOT 1
- Demo video
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from 4dface.