Comments (3)
Hi, we use all the pixels as the target for the other network during training, without any threshold selection. This makes our approach simple and clean.
In the early stage of training, there must exist some pixels with wrong predictions in both networks. Let's consider these situations (two columns in each row means whether the prediction of each network is correct):
(1) Correct, Correct
(2) Correct, Wrong
(3) Wrong, Correct
(4) Wrong, Wrong
In (1)(3), the target is correct, so the prediction is supervised with the correct signal.
In (4), both the prediction and the target are wrong, but the prediction will be punished. So it is hard to say whether it is harmful or not.
In (2), the supervision signal is wrong, which may be harmful.
I think our CPS works well because the advantages outweigh the disadvantages that exist in these four situations. One may design an algorithm to suppress the wrong supervision signal in the early training, which may further improve CPS.
from torchsemiseg.
Thanks for your patient reply! The method is very simple and effective.
By the way, If it is simply set the threshold of segmentation score of networks output, above a certain threshold as a pseudo label, like GCT. Does it work? Have you done any experiments like this?
from torchsemiseg.
We haven't conducted experiments like this. Since the code and data are released, one could try different strategies themselves~
from torchsemiseg.
Related Issues (20)
- CPS loss
- Pseudo labeling question HOT 2
- training with one GPU HOT 4
- About the explaination of Single-network pseudo supervision
- a question about CPC you mentioned in your paper HOT 2
- File-related questions.
- About the cps_weight with different labeled_ratio HOT 1
- Questions related to Cut-Mix. HOT 1
- Questions about CPS loss. HOT 2
- Image present in both labeled and unlabeled splits HOT 2
- Memory and Inf time (fps) for CPS HOT 2
- Question about the batchnorm while trainning HOT 1
- About pretrained weights HOT 1
- How to resume the trained model
- Download the data (VOC, Cityscapes) and pre-trained models from [OneDrive link] is not found HOT 5
- Question about the optimizer HOT 1
- Run Error HOT 2
- Conflicting Issues Upon Installation (Linux): UnsatisfiableError: The following specifications were found to be incompatible with each other
- About init networks and optimizer
- What are the differences between CPS and Co-training?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from torchsemiseg.