c00renut / deep-blind-watermark-removal

[AAAI 2021] Split then Refine: Stacked Attention-guided ResUNets for Blind Single Image Visible Watermark Removal

This repo contains the code and results of the AAAI 2021 paper:

Split then Refine: Stacked Attention-guided ResUNets for Blind Single Image Visible Watermark Removal
Xiaodong Cun, Chi-Man Pun^*
University of Macau

Datasets | Models | Paper | 🔥Online Demo!(Google CoLab)

---

The overview of the proposed two-stage framework. Firstly, we propose a multi-task network, SplitNet, for watermark detection, removal and recovery. Then, we propose the RefineNet to smooth the learned region with the predicted mask and the recovered background from the previous stage. As a consquence, our network can be trained in an end-to-end fashion without any manual intervention. Note that, for clearness, we do not show any skip-connections between all the encoders and decoders.

---

The whole project will be released at the January of 2021 (almost).

Datasets

We synthesized four different dataset for training and testing, you can downlaod the dataset via One Drive.

Pre-trained Models

• 27kpng_model_best.pth.tar (google drive)

Other Pre-trained Models are still reorganizing and uploading, it will be released soon.

Demos

An easy-to-use online demo can be founded in google colab.

The local demo will be released soon.

Pre-requirements

pip install -r requirements.txt

Train

Besides training our methods, here, we also give an example of how to train the s2am under our farmewrok. More details can be founded in the shell scripts.

bash examples/evaluation.sh

Test

bash examples/test.sh

Acknowledgements

The author would like to thanks Nan Chen for her helpful discussion.

Part of the code is based upon our previous work on image harmonization s2am

Citation

If you find our work useful in your research, please consider citing:

@misc{cun2020split,
      title={Split then Refine: Stacked Attention-guided ResUNets for Blind Single Image Visible Watermark Removal}, 
      author={Xiaodong Cun and Chi-Man Pun},
      year={2020},
      eprint={2012.07007},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Contact

Please contact me if there is any question (Xiaodong Cun [email protected])