GithubHelp home page GithubHelp logo

niopeng / chimle Goto Github PK

View Code? Open in Web Editor NEW
9.0 2.0 1.0 33.29 MB

PyTorch - CHIMLE, an IMLE-based general-purpose multimodal conditional image synthesis method [NeurIPS 2022]

License: Apache License 2.0

HTML 27.71% CSS 1.16% Python 50.34% C 2.12% C++ 2.74% Cuda 15.93%
colorization conditional-image-generation generative-model image-decompression image-to-image-translation night-to-day super-resolution computer-vision deep-learning image-generation

chimle's People

Contributors

niopeng avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

Forkers

beelswheelson

chimle's Issues

Questions about super-resolution task.

Thanks for your great work. Here's a question about super-resolution task. I downloaded the butterfly datasets (n02279982) and try to generate the SR results under 16x factor. I don't know how you divided the training and testing datasets, so i tested on the whole datasets. However, i didn't get the similar results with yours, some samples showcase significant errors. All the conditions are following your file, except for the down-sampling strategy. Is that possible that the down-sampling method can cause these errors? Looking forward to your reply.

Multiple "Start training" printed

Hello,

Thanks for sharing your creative work. I want to reproduce the colourization result and run your code on single V100 GPU of HPC server. However, in the beginning of print_log.txt I found something very strange:

Random Seed: 0
read lmdb keys from cache: /home/chihchieh/CHIMLE/code/data/colorization_dataset/c_filename.lmdb/_keys_cache.p
Dataset [ColourizationDataset - Train_Colourization] is created.
Number of train images: 721, iters: 2
Total epochs needed: 20 for iters 400,000
read lmdb keys from cache: /home/chihchieh/CHIMLE/code/data/colorization_dataset/c_filename.lmdb/_keys_cache.p
Dataset [ColourizationDataset - Validation_Colourization] is created.
Number of val images in [Validation_Colourization]: 721
initialization method [kaiming]
Remove pixel loss.
Loading model from: /home/chihchieh/CHIMLE/code/models/weights/v0.1/vgg.pth
Mapping network param multiplier: 0.010000 with total length 64
---------- Model initialized ------------------
Number of parameters in G: 210,614,288
Number of parameters in F: 14,714,688


Model [CHIMLEModel] is created.
---------- Start training -------------
---------- validation -------------
Random Seed: 0
read lmdb keys from cache: /home/chihchieh/CHIMLE/code/data/colorization_dataset/c_filename.lmdb/_keys_cache.p
Dataset [ColourizationDataset - Train_Colourization] is created.
Number of train images: 721, iters: 2
Total epochs needed: 20 for iters 400,000
read lmdb keys from cache: /home/chihchieh/CHIMLE/code/data/colorization_dataset/c_filename.lmdb/_keys_cache.p
Dataset [ColourizationDataset - Validation_Colourization] is created.
Number of val images in [Validation_Colourization]: 721
initialization method [kaiming]
Remove pixel loss.
Loading model from: /home/chihchieh/CHIMLE/code/models/weights/v0.1/vgg.pth
Mapping network param multiplier: 0.010000 with total length 64
---------- Model initialized ------------------
Number of parameters in G: 210,614,288
Number of parameters in F: 14,714,688


Model [CHIMLEModel] is created.
---------- Start training -------------
---------- validation -------------
Random Seed: 0
read lmdb keys from cache: /home/chihchieh/CHIMLE/code/data/colorization_dataset/c_filename.lmdb/_keys_cache.p
Dataset [ColourizationDataset - Train_Colourization] is created.
Number of train images: 721, iters: 2
Total epochs needed: 20 for iters 400,000
read lmdb keys from cache: /home/chihchieh/CHIMLE/code/data/colorization_dataset/c_filename.lmdb/_keys_cache.p
Dataset [ColourizationDataset - Validation_Colourization] is created.
Number of val images in [Validation_Colourization]: 721
initialization method [kaiming]
Remove pixel loss.
Loading model from: /home/chihchieh/CHIMLE/code/models/weights/v0.1/vgg.pth
Mapping network param multiplier: 0.010000 with total length 64
---------- Model initialized ------------------
Number of parameters in G: 210,614,288
Number of parameters in F: 14,714,688


Model [CHIMLEModel] is created.
---------- Start training -------------
---------- validation -------------
Random Seed: 0
read lmdb keys from cache: /home/chihchieh/CHIMLE/code/data/colorization_dataset/c_filename.lmdb/_keys_cache.p
Dataset [ColourizationDataset - Train_Colourization] is created.
Number of train images: 721, iters: 2
Total epochs needed: 20 for iters 400,000
read lmdb keys from cache: /home/chihchieh/CHIMLE/code/data/colorization_dataset/c_filename.lmdb/_keys_cache.p
Dataset [ColourizationDataset - Validation_Colourization] is created.
Number of val images in [Validation_Colourization]: 721
initialization method [kaiming]
Remove pixel loss.
Loading model from: /home/chihchieh/CHIMLE/code/models/weights/v0.1/vgg.pth
Mapping network param multiplier: 0.010000 with total length 64
---------- Model initialized ------------------
Number of parameters in G: 210,614,288
Number of parameters in F: 14,714,688


Model [CHIMLEModel] is created.

I mean, looks like training steps are repeated several times but I do not find anything related to parallel/distributed training on train.py. Is it normal or did I do anything wrong? Could you give me some suggestions?

Thanks for your help.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.