Comments (7)
This line will call _dequeue_and_enqueue
from real-esrgan.
@xinntao Yes, this line call self._dequeue_and_enqueue(). I just cannot figure out how your code use self.queue_lq and self.queue_gt . I cannot find some other codes to use this two member variables。I know the role of this code block is to put input data in training pool. How does the code reach this goal?
from real-esrgan.
- It first randomly shuffle the image in the pool
- then get first N samples for self.lq and self.gt
- Finally, we obtain the shuffled self.lq and self.gt
from real-esrgan.
I get it. Thanks for your patient explain! So poor my understanding about the _dequeue_and_enqueue function!
from real-esrgan.
Hi, @xinntao. Thank you for the awesome work !
I also somewhat do not understand the purpose of this function.
Why do we need to sample the training batch from a pool of images ?
As far as I can tell the most obvious reason is to avoid creating a batch
from sequential indices. But we already shuffle the indices in EnlargedSampler.
So the batch will not be sequential.
On the other hand the shuffling may result in some samples being used more
then once. Is this a technique for improving training ?
Thanks in advance,
Arseny
from real-esrgan.
@Arseny-N
Batch processing in pytorch limits the diversity of synthetic degradations in a batch. For example, samples in a batch could not have different resize scaling factors. Therefore, we employ a training pair pool to increase the degradation diversity in a batch.
from real-esrgan.
Thank you for the timely explanation!
from real-esrgan.
Related Issues (20)
- funky result HOT 2
- Trying to use AMF for FFMPEG
- ModuleNotFoundError: No module named 'torchvision.transforms.functional_tensor' HOT 7
- 使用RMSprop优化器问题
- ModuleNotFoundError: No module named 'torchvision.transforms.functional_tensor' HOT 8
- 关于用自己第一次训练好的模型,再用新的数据继续迭代训练的问题 HOT 2
- Colab started failing HOT 2
- 请问该项目支持模型的增量学习吗?
- how to use HOT 5
- Request the YML file of (realesr-general-x4v3.pth) HOT 1
- vkQueueSubmit failed -4 (Error)
- OST: https://openmmlab.oss-cn-hangzhou.aliyuncs.com/datasets/OST_dataset.zip无法下载了 HOT 3
- 训练数据集是jpg格式,退化过程还需采取jpeg压缩吗
- ModuleNotFoundError HOT 3
- 模型训练时不使用gpu HOT 2
- UserWarning:The parameter 'pretrained' is deprecated since 0.13 and may be removed in the future, please use 'weights' instead.
- How to train the model with double gpu? HOT 2
- Can someone make a simple exe for CPU users? HOT 2
- ModuleNotFoundError: No module named 'torchvision.transforms.functional_tensor' HOT 2
- 一些评价及建议 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from real-esrgan.