GithubHelp home page GithubHelp logo

ephemeral182 / udr-s2former_deraining Goto Github PK

View Code? Open in Web Editor NEW
127.0 2.0 7.0 166.02 MB

[ICCV'23] Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streaks

Home Page: https://ephemeral182.github.io/UDR_S2Former_deraining/

Python 100.00%
deraining raindrop rain-streak demo iccv2023 image-restoration rain-removal adverse-weather-condition transformer uncertainty-estimation

udr-s2former_deraining's Issues

Version of pytorch-lightning

Hi! It is a great and intersting work. But I am wondering the version of pytorch-lightning you used because I met some problem with the latest version (v2.x)

training on .pth files

@Ephemeral182
Is there a way to use the pretrained .pth files such as (udrs2former_agan.pth) in the training loop for further training. From what I have run, the training loop requires a checkpoint file with epoch, lr_optimizer, etc info which the .pth does not contain.

Is there any way to get the checkpoints file or hyperparameters of the final udrs2former_agan.pth file that your included in you github repo. Thanks.

Regarding the issue with testing

Hello, thank you for your excellent work.
However, there are some issues with the provided code that have troubled me:
The saved model cannot be used when loaded in the test.

I would be grateful if you could provide me with the relevant assistance.

GPU and Time

Hello, how many GPUs are need for training and how long does it takes?

Training loop

Hi, I enjoyed reading the paper and testing the project that you have developed.

I trained on my end and noticed that as the train loss and validation loss keeps decreasing (becomes negative even) the PSNR and SSIM still continue to increase.

When I train I got a train loss of -44.28 and validation loss of -29.18 but the PSNR is 27.73 and SSIM is .8729 (best case in my training). In my understanding shouldn't the loss be closer to 0 if you are trying to get a 1:1 correspondence between ground truth and the raindrop image.

visualizing uncertainty graphs

This is a great job, but can the author provide code for visualizing uncertainty graphs so that the work can be better disseminated.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.