Comments (8)
Sorry for the late response, loaded with work currently. I see your problem and for me it seems like an issue with the correct training technique. Like again checking more hyperparameters, choosing right optimizer, training model (already trained with ADAM) with just SGD (sometimes help), or anneal already trained model.
Also I wouldn't expect the same performance between different frameworks because such performance differences take place quite often.
Moreover our model and TF model are not perfectly identical as we introduced batchnorm between convolution layers because without it we couldn't train it at all.
from monodepth-pytorch.
Thanks for the replying. I trained Resnet50_md from scratch using this code. The training set is the same as Godard's. Then we test it on the Kitti Eigen's split and find the best RMSE is 5.3, worse than the ones of Godard's paper. I've tried many settings of batch size or learning rate but it still produce not better results.
Can you explain how you calculated RMSE in this code?
#22 Check this issue.
from monodepth-pytorch.
Hey @JesseZhang92. Unfortunately we didn't test our model in terms of metrics for depth evaluation but only made visual inspection of disparity maps and loss value. However, we'll probably add this in the future. What about your tests did you do it on our pretrained model or train it from scratch using this code?
from monodepth-pytorch.
Thanks for the replying. I trained Resnet50_md from scratch using this code. The training set is the same as Godard's. Then we test it on the Kitti Eigen's split and find the best RMSE is 5.3, worse than the ones of Godard's paper. I've tried many settings of batch size or learning rate but it still produce not better results.
from monodepth-pytorch.
Here the RMSE is calculated within 50m. In Godard's paper the corresponding results should be 4.471 in Table. 2.
from monodepth-pytorch.
Thanks for the replying. I trained Resnet50_md from scratch using this code. The training set is the same as Godard's. Then we test it on the Kitti Eigen's split and find the best RMSE is 5.3, worse than the ones of Godard's paper. I've tried many settings of batch size or learning rate but it still produce not better results.
Can you explain how you calculated RMSE in this code?
from monodepth-pytorch.
Thanks for the replying. I trained Resnet50_md from scratch using this code. The training set is the same as Godard's. Then we test it on the Kitti Eigen's split and find the best RMSE is 5.3, worse than the ones of Godard's paper. I've tried many settings of batch size or learning rate but it still produce not better results.
Can you explain how you calculated RMSE in this code?
Hi, it has been a long time since I used this project. As I remember, you should carefully follow the evaluation protocol provided in the original project https://github.com/mrharicot/monodepth/blob/master/utils/evaluation_utils.py, and https://github.com/mrharicot/monodepth/blob/master/utils/evaluate_kitti.py.
Some 'masking' operations may influence the performance as it changes the valid points that measured. You may carefully check these operations.
from monodepth-pytorch.
Thanks for the replying. I trained Resnet50_md from scratch using this code. The training set is the same as Godard's. Then we test it on the Kitti Eigen's split and find the best RMSE is 5.3, worse than the ones of Godard's paper. I've tried many settings of batch size or learning rate but it still produce not better results.
Can you explain how you calculated RMSE in this code?
Hi, it has been a long time since I used this project. As I remember, you should carefully follow the evaluation protocol provided in the original project https://github.com/mrharicot/monodepth/blob/master/utils/evaluation_utils.py, and https://github.com/mrharicot/monodepth/blob/master/utils/evaluate_kitti.py.
Some 'masking' operations may influence the performance as it changes the valid points that measured. You may carefully check these operations.
Do you still have your code?
Is it a problem for you to send me part of the code as you did, if necessary I can contact you privately.
from monodepth-pytorch.
Related Issues (20)
- This code is able to reproduce similar results to those in the original paper HOT 16
- RMSE keeps increasing after 25 epochs training while disparity prediction looks fine
- Question about how to get the original image HOT 1
- How do you compute L-R Consistency HOT 1
- Difference between ResNet50_md and ResNet model
- why the disp_gradient_loss, lr_loss is zero and the total loss is not getting converging?
- test my data HOT 2
- How can I get deep information? HOT 2
- disparity map error HOT 1
- [Question] How to get the metric disparity value? HOT 3
- [Feature requested] Support for depth-separable(depth-wise) backbones such as MobileNetV2, EfficientNet... HOT 1
- Can anyone provide the download URL of pretrained model 'monodepth_resnet18_001_cpt.pth' in this repository? HOT 6
- Why horizontal flip HOT 1
- Key already registered with the same priority: GroupSpatialSoftmax HOT 1
- Does this work on stereo image pair (not video) HOT 3
- How to interpolate the sparse gt depth map? HOT 1
- What is the loss value of the trained model? HOT 1
- Training data with monocular HOT 1
- datasets HOT 1
- How can I generate depth maps for other image datasets using the code here?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from monodepth-pytorch.