Comments (5)
@boya34 it isn't the original image, but the low resolution image being given to the unet. although paper was scant on details on upsampler, any resolution smaller than the low resolution image given to the unet, and the unet would simply learn to downsample
from gigagan-pytorch.
thank you for your reply, but I still feel a bit confused, let me explain in more detail.
As the paper says, the input image size of unet is 64 pixels, and the output image size is 512 pixels, so in version 0.2.6 the allowable rgb resolutions is [128, 256](bigger than 64 and smaller than 512), while the multiscale_input_resolutions is [64, 32, 16, 8], this mismatching will lead to an error (the related assertion is around line 1841 in gigagan_pytorch.py).
Besides, the rgbs choose the size bigger than original size which is 64 (in unet_upsampler.py), so the rgb_index is [128, 256, 512] , but it should be the same as multiscale_input_resolutions(the related assertion is around line 1627 in gigagan_pytorch.py).
The paper says the generator producing a pyramid {xi}, and x0 is the full image(64 pixels I guess), so I understand the meaning of multiscale_input_resolutions, could you please tell me more about the other two arrays? thanks a lot.
from gigagan-pytorch.
@boya34 you can resolve this error (and perhaps i should auto-resolve it for unet as it is confusing), by setting Discriminator(multiscale_input_resolutions = unet.allowable_rgb_resolutions)
i have also decided to just default to sending the discriminator the low resolution input image (going into the unet) as the lowest resolution rgb always
from gigagan-pytorch.
@lucidrains I get what you mean, Thank you again!
from gigagan-pytorch.
no problem, happy training!
from gigagan-pytorch.
Related Issues (20)
- Confused about this project?
- NaN losses after hours of training (UPSAMPLER) HOT 16
- How to implement this model to enhance my input images? Do I have to train the model to use? HOT 2
- Weights of Gigagan Upscaler HOT 1
- Turn on/off gradients computation between generator/discriminator HOT 2
- Wrong order of resolutions list HOT 1
- to_rgb branch has only 1 learnable kernel HOT 7
- Gradient Penalty is very high in the start HOT 10
- How to use this model for SR ?
- Has Anyone Trained This Model Yet? HOT 2
- The text-to-image tasks
- Config to reproduce paper
- question about code in unet_upsampler.py HOT 1
- the loss became nan after a few train steps HOT 2
- [News] Videogigagan is published. HOT 4
- Standard Attention vs ViTGAN Attention HOT 1
- support 256x256 images HOT 1
- Loss turned `NaN` when custom training HOT 1
- How to adapt this network to image to image translation task
- Video? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from gigagan-pytorch.