GithubHelp home page GithubHelp logo

Comments (3)

wvangansbeke avatar wvangansbeke commented on August 24, 2024

Hi @griffintin,

I increased the stability of the training process a while ago and I also made it converge faster by adding skip connections between the global and local network. Initially I only used guidance by multiplication with an attention map (=probability), but found out that it is less robust and that differences between a focal MSE and vanilla MSE loss function were now negligible. Be aware that this change will alter the appearance of the confidence maps since fusion takes place at mutliple stages now (see README).

In short: if you want the old version, just remove the skip connections to get the original confidence maps. The results should be similar and you should get a sense of interpretability. If only the numbers on the benchmark matter, don't alter it.

Best,
Wouter

from sparse-depth-completion.

griffintin avatar griffintin commented on August 24, 2024

@wvangansbeke

Thank you for quick reply, really appreciate it.

Yes, before I posted my questions , I have noticed your recent improvement with the skip connections between global-local networks.

Still, I am not clear about the loss functions. Since both networks need to learn the uncertainty maps, I guess "MSE_loss_uncertainty" should be used instead of the default mse_loss.

Please correct me if I miss-understood.

Regards

from sparse-depth-completion.

wvangansbeke avatar wvangansbeke commented on August 24, 2024

Hi @wvangansbeke,

Yes you can but the differences will be small. Try with a vanilla MSE loss first to make sure the rest is correct (e.g. dataloading).

Best,
Wouter

from sparse-depth-completion.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.