Comments (5)
It can be in principle, you would need to add triangles that cover the mouth to the mesh. The issue is that it would be difficult to make the swapped mouth look realistic.
Imagine a situation where the photo you are taking the texture from has the mouth closed. Then imagine the person in front of the camera opens their mouth. The effect would not be very satisfying as the texture for the whole open mouth would have to be generated from a very thin piece of the source image.
There are ways of dealing with this through machine learning, you can see this paper as an example.
from faceswap.
It can be in principle, you would need to add triangles that cover the mouth to the mesh. The issue is that it would be difficult to make the swapped mouth look realistic.
Imagine a situation where the photo you are taking the texture from has the mouth closed. Then imagine the person in front of the camera opens their mouth. The effect would not be very satisfying as the texture for the whole open mouth would have to be generated from a very thin piece of the source image.
There are ways of dealing with this through machine learning, you can see this paper as an example.
ok,thank you.But the eyes always don't blink.And when a frame has no face,the dst face still appear
from faceswap.
Yes, both of those are true. If you didn't want the eyes to appear you could remove the triangles that correspond to the eyes from the mesh. I think that the eyes are a bit less jarring than the mouth as eyelid movement changes the shape of the face much more.
from faceswap.
Yes, both of those are true. If you didn't want the eyes to appear you could remove the triangles that correspond to the eyes from the mesh. I think that the eyes are a bit less jarring than the mouth as eyelid movement changes the shape of the face much more.
How to change blendshapes to change expressions?
from faceswap.
Could you elaborate on what you mean by that?
from faceswap.
Related Issues (20)
- face moving while blinking HOT 1
- Overlay Transparency HOT 1
- Question mean3DShape HOT 1
- The principle about the algorithms in 'FaceSwap' HOT 1
- Real Time? HOT 1
- RuntimeError: Unable to open ../shape_predictor_68_face_landmarks.dat HOT 1
- Face texture. HOT 5
- google colab HOT 1
- How to interupt the script? HOT 1
- How to make eye blinking HOT 6
- How can run zad2.py without camera HOT 1
- Face Vibrating HOT 2
- Multiple faces in source or target video HOT 4
- How to create my own candide.npz
- Faces not properly aligned in the final image
- Error with predictor HOT 1
- About gesture control and masks
- cv2.error: OpenCV(4.5.2-dev) :-1: error: (-5:Bad argument) in function 'pointPolygonTest' HOT 3
- face reading 3D...
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from faceswap.