Comments (5)
Can you add instructions for reproducing the issue?
from dot.
No special instruction really here. I Just used the command as described in the file in that exact way on some sample files.
dot --swap_type simswap --target ./data --use_gpu --source "./data" --parsing_model_path ./saved_models/simswap/parsing_model/checkpoint/79999_iter.pth --arcface_model_path ./saved_models/simswap/arcface_model/arcface_checkpoint.tar --checkpoints_dir ./saved_models/simswap/checkpoints --save_folder ./test_local --use_image
from dot.
I took a closer look at the results, it seems like the whole chin-part of the face is not really swapped at all, that's why the output faces look really strange. Is it to be expected from these models used in this utility that the chin part of the face is not swapped? Does this maybe has something to do with how the model used is exactly trained?
If I look at the faceswap with camera I see the same thing happening, my own chin is basically still in the picture instead of the swapped face's chin. Is this happening to others as well?
from dot.
@epicstar7 SimSwap works by taking the latent ID of the facial features from the source image, and places it on the target. It doesn't take head features into account during swaps. You would have to train a model for it, as well as modify the SimSwap's training code to get the head features rather than face features. Also, removing the mask parameter or training another face parsing model could help as well if it cuts out too much of the face.
from dot.
Ok I experimented some more and it turned out that the problem was due to the face in target image being too small. This is quite interesting because when I swap the same images in SimSwap directly there are no problems.
I did notice thought that the output path using --save_folder is not working correctly, it just saves the files to the main project folder instead of the chosen folder.
from dot.
Related Issues (20)
- Using dot with other/individual faces? HOT 1
- ERROR: Package 'dot' requires a different Python: 3.10.8 not in '<3.9,>=3.8' HOT 4
- Add Python 3.10 support
- There is no "[python.exe]: fomm" in Windows dropdown HOT 3
- My face is appearing in Cam and FOMM but the dot can't swap face in my cam and images from the data folder HOT 1
- EnvironmentFileNotFound: 'C:\Users\envs\environment-cpu.yaml' file not found HOT 2
- Can Dot work good on a laptop core5 with Nvidia GTX 750? HOT 1
- Possible to convert into exe? HOT 2
- How to run dot? HOT 9
- run dot HOT 2
- How to use OBS Virtual Camera as captured camera HOT 2
- Accidently submited this
- How can I convert it into exe? HOT 4
- Torch and torchvision check issue HOT 4
- Run dot on Silicon Mac M1/M2 HOT 2
- SimSwap & SimSwap HQ are not working HOT 6
- ERROR: No matching distribution found for onnxruntime-gpu==1.9.0 HOT 1
- Can I deepfake a face from a picture I have or am I only limited to the faces that are included in the project? HOT 1
- No audio? HOT 1
- SimSwap on videos not working in colab demo HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dot.