Comments (5)
Hi, Thank you for your interest in our work. As I can tell from the plot, you have successfully trained the model. Because our work are not able to handle front back confusion, we only evaluate the samples with angle range from (-90,90) which is demonstrated in the paper. Our evaluation code will map any prediction outside of (-90,90) back to the range.
from slfm.
Got it, but is there any way to avoid those predicted values in the mean and median calculation? Since it shows that the mean is very high.
Additionally, my vision model also seems to be a little inaccurate. Do you have any suggestions on this? Thank you so much!
from slfm.
As I mentioned above, in our paper and released code, we evaluated samples that have angles within (-90,90). Specifically, in the test set, we filter out the samples that have angles outside of (-90,90) and create a new split for evaluation, i.e., https://github.com/IFICL/SLfM/tree/master/Dataset/AI-Habitat/data-split/hm3d-4view-rotation-filterangle.
You can create this split by
python create-csv.py --dataset='hm3d-4view-rotation' --type='hm3d-4view-rotation-filterangle' --data_split='9:1:1' --filter_angle
from slfm.
For the vision model, first of all, I noticed one thing is strange the vision model makes predictions greater than 90 degrees, which doesn't match with my given training config --finer_rotation
which contains the rotation prediction within (-90, 90). The code is https://github.com/IFICL/SLfM/blob/master/slfm/models/slfm_geo_net.py#L326 .
One possible reason it happens is that you don't enable --finer_rotation
when you run the evaluation code, leading to inaccurate results because of different outputs. The code is https://github.com/IFICL/SLfM/blob/master/slfm/evaluation/evaluate_angle.py#L79
Because we generate the two rotated views with an FOV of 60 degrees, we constrain rotation within 90 degrees to ensure there will be visual signals to pick up
from slfm.
Got it, I'll try --finer_rotation, thank you so much!
from slfm.
Related Issues (6)
- I meet promblems when I run multi-preprocess.sh in path /SLfM/AI-Habitat HOT 9
- Platform::WindowlessEglApplication::tryCreateContext(): cannot get default EGL display: EGL_BAD_PARAMETER WindowlessContext: Unable to create windowless context HOT 1
- Question about dataset HOT 1
- Demo code HOT 14
- can't train on resnet 50 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from slfm.