Comments (9)
If you're willing to use the un-refactored code, I can provide it here... haven't tested whether it works in the latest version though, but the idea should be the same.
face_dataset.zip
from vid2vid.
I believe the network input is just the raw black & white edge image and the output is the photorealistic face image matching those edges.
from vid2vid.
Even just getting the code that was used to detect/connect the face landmarks and generate background edges for the edge map sketch for a single video frame would be great. dlib (http://dlib.net/ml.html) was cited in the paper, but it would be nice to have the code that merges the connected facial landmark sketch with the background edges from the canny edge detector.
from vid2vid.
I do wonder: is the training input just the binarized facial features and edge map? Or are the different facial features mapped to different channels? Even the paper is pretty unclear about it.
from vid2vid.
Would be great to get confirmation (& copy pastable commands/python code) from the OPs @tcwang0509 @junyanz or anyone else please.
from vid2vid.
Actually digging into the source code, this repo is not complete. It is missing face_dataset.py
As of bdb7ec6, this will fail on line 11 of custom_dataset_data_loader.py
from data.face_dataset import FaceDataset
I'm wondering why this code was not included as it is quite valuable and (at least to me and some other folks) more interesting than the segmentation map, change landscape based code/ideas.
Opened issue: #26
from vid2vid.
Yes we'll update the face dataset part shortly. As pointed out, we run landmark (using dlib library) and edge detection on the face images, and use the B&W image as input. I'm currently in an urgent deadline, and probably won't be able to update it until next week or the week after though...
from vid2vid.
@tcwang0509 Appreciate your answer & time. Could you please outline what would be needed to do to at least stub it out/reimplement it (as detailed as possible) ? Or is it too complicated and better for you to just dump the code? Very much want to have this working by this coming Monday/Tuesday as training also takes time.
from vid2vid.
@tcwang0509 Love it, thank you very much, that's all I need right now, thanks!
from vid2vid.
Related Issues (20)
- test only with keypoints
- [QUESTION] Google colab HOT 1
- Where is the "pre-trained segmentation algorithm" in the repo?
- Sequence length: How to limit that to 30, it is increasing automatically as the no. of epochs is increasing
- Using Openpose docker image with vid2vid
- Is there any ways to improve the output quality of the pose model?
- Sometimes ran into RuntimeError: Given groups=1, weight of size [64, 18, 7, 7]... when training. HOT 3
- Inference time - How much FPS is possible?
- Error HOT 1
- How to test “pose-to-body”?
- RuntimeError: CUDA error: throwing an instance of 'c10::Error' HOT 1
- Vid HOT 1
- RuntimeError: Legacy autograd function with non-static forward method is deprecated. HOT 2
- FID evaluation
- Errors when running on CPU without CUDA
- RuntimeError: DataLoader worker (pid(s) 22100) exited unexpectedly HOT 1
- AttributeError: module 'torch._C' has no attribute '_cuda_setDevice' HOT 1
- "Pretrained network G0 has fewer layers..."
- Nivda
- Download gdrive doesn't work - need to manually download model for now HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from vid2vid.