hila-chefer / targetclip Goto Github PK
View Code? Open in Web Editor NEW[ECCV 2022] Official PyTorch implementation of the paper Image-Based CLIP-Guided Essence Transfer.
[ECCV 2022] Official PyTorch implementation of the paper Image-Based CLIP-Guided Essence Transfer.
steps to reproduce
!git clone https://github.com/hila-chefer/TargetCLIP.git
%cd /content/TargetCLIP
!python /content/TargetCLIP/optimization/find_dirs.py
Traceback (most recent call last):
File "/content/TargetCLIP/optimization/find_dirs.py", line 9, in <module>
from criteria.clip_loss import CLIPLoss
ModuleNotFoundError: No module named 'criteria'
but criteria is in the root directory
I wonder how to encode target or source image in latent space. I usually use e4e, image2styleGAN, which one did you use?
TargetCLIP/optimization/find_dirs.py
Lines 142 to 144 in b5dd2a4
In these lines the latents are recalculated in the nested loop in every inner loop. The latents themselves stay constant though, so it can be done once outside of these loops. Only the augmented latents (latents + direction) need to be recalculated here.
Great work! I tried to train my own dirs, but failed in some case. Are you using the default parameters to get them?
Hello again,
in these marked lines you initialize a set of coefficients to optimize over. As far as I can see, these are not mentioned in the paper. The coefficients are multiplied by the direction per source image, so I get that you want to optimize for a different scale of the direction vector per source vector. I have some questions on this:
Thanks again for your work! I hope I am not too picky on this - I'm just curious about the topic of semantics in these latent spaces :-)
TargetCLIP/optimization/find_dirs.py
Lines 123 to 140 in b5dd2a4
amazing work
let me congratulate you on this incredible job, unfortunately I don't have the computing power to train targets, I'd like you to add some celebrity targets like megan fox and emilia clacke, and other celebrities.
and add new ones, for people who don't have a gpu, every week if they have free time and no work is busy.
I ran this command to reproduce your results:
python3 optimization/find_dirs.py --target_path dirs/targets/avatar.jpg --dir_name results_folder_avatar --weight_decay 3e-3 --lambda_consistency 0.6 --step 1000 --lr 0.2 --num_directions 8 --num_images 8
But I got strange result as bellow: here is some results. Anything wrong with me?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.