Comments (3)
Hi @XiaLiPKU ! This work is wonderful and thanks so much for releasing the code.
May I ask a question? I used your pretrained model to evaluate on val set and got 80.50% mIoU using single-scale test, but when I trained this model from scratch, I can only get 79.44% finally, which is supposed to be 80.05%.
I just followed your default settings(using pretrained ResNet weights, batch size 16,4 gpus, 30k iterations and so on...).
Are there any other techniques special you adopted to get this final model?
Looking forward to your reply!
Hi! Sorry for reply too late.
For the pretrained model, the SS result on the val set is 80.51instead of 80.05.
The score 80.05 is achieved in my ICCV paper. And in this repo, the performance is significantly higher than that. I refine the detail just to help my followers to make full use of my repo.
Therefore, I guess the problem may lie in the image reading process.
In my experience, different version of cv2's imread function differently. So this may also occur to PIL. I guess this may be the source of bug. I recommend you check the cv2 or PIL version, and do carefully ablation study of the library. I used to do image processing task, so I just known how important this factor can be.
Moreover, if you use other's code for inference, I also don't guarantee the final performance. If so, you can carefully check the differences between the code you run and the code in my eval.py.
To be honest, I have shown all the training and inference details in this repo. There's no other so-called 'tricks' hidden by myself. For the 80.99 mIoU I report in the top of the repo, I really adopt some tricks, which I would never use in my paper.
from emanet.
Thanks so much for your patient reply! @XiaLiPKU
I never thought PIL version would cause a difference. Thanks for telling me that. Could you please tell me your PIL version?
For reproducing, I just used your eval.py script, so it is not supposed to be the problem.
By the way,"For the 80.99 mIoU I report in the top of the repo, I really adopt some tricks, which I would never use in my paper."--Are these tricks included in your code? In this repo, it seems that you save the checkpoints every 2000 iterations, so I guess 80.99 is the highest IoU on val set among these models, instead of the final checkpoint?
from emanet.
Thanks so much for your patient reply! @XiaLiPKU
I never thought PIL version would cause a difference. Thanks for telling me that. Could you please tell me your PIL version?
For reproducing, I just used your eval.py script, so it is not supposed to be the problem.
By the way,"For the 80.99 mIoU I report in the top of the repo, I really adopt some tricks, which I would never use in my paper."--Are these tricks included in your code? In this repo, it seems that you save the checkpoints every 2000 iterations, so I guess 80.99 is the highest IoU on val set among these models, instead of the final checkpoint?
I just use the final checkpoint.
The trick for 80.99 is just for fun.
I will never use it for public usage,
and also will not use in the repo
from emanet.
Related Issues (20)
- selection of K HOT 1
- The training process was stopped HOT 2
- How long does it take to train EMANet with a Resnet-101 backbone? HOT 2
- why does EMANet suffer from vanishing /exploding gradient even though T_train (=3) is small?
- can't reproduce the ablation study results in figure 3, 4
- The result to Image
- for the pretrained ResNet152 HOT 1
- The pre-trained Resnet-50 and Resnet-101 can't be downloaded HOT 2
- Could you please tell me where is the code to put the input data in GPU? HOT 1
- moving averaging operation HOT 1
- About the BN!!! HOT 1
- Could you release the MS+Flip test code?
- ResNet18 pretrained model HOT 1
- FLOPs HOT 1
- about voc12
- Why use padding for ValDataset?
- Hello, may I ask how not to apply your pre-training model from scratch training?
- Can you provide a detailed training environment?
- Train in the COCO dataset
- How could I reproduce the performance reported in paper with this repo?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from emanet.