Dual Residual Networks

By Xing Liu¹, Masanori Suganuma^1,2, Zhun Sun², Takayuki Okatani^1,2

Tohoku University¹, RIKEN Center for AIP²

Abstract
Citation
Numerical Results
Models
Datasets
Test
Train (in preparation)
Visual Results

Abstract

In this paper, we study design of deep neural networks for tasks of image restoration. We propose a novel style of residual connections dubbed “dual residual connection”, which exploits the potential of paired operations, e.g., upand down-sampling or convolution with large- and smallsize kernels. We design a modular block implementing this connection style; it is equipped with two containers to which arbitrary paired operations are inserted. Adopting the “unraveled” view of the residual networks proposed by Veit et al., we point out that a stack of the proposed modular blocks allows the first operation in a block interact with the second operation in any subsequent blocks. Specifying the two operations in each of the stacked blocks, we build a complete network for each individual task of image restoration. We experimentally evaluate the proposed approach on five image restoration tasks using nine datasets. The results show that the proposed networks with properly chosen paired operations outperform previous methods on almost all of the tasks and datasets.

Citation

@inproceedings{DuRN_cvpr19,
title={Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restoration},
author={Liu, Xing and Suganuma, Masanori and Sun, Zhun and Okatani, Takayuki},
booktitle={arXiv preprint arXiv:1903.08817},
year={2019},
}

Numerical results

Please find them in the test/results_confirmed.txt file.

Models

Please find them here.

Datasets

Gaussian noise removal

BSD500-gray (used in our paper)
If you also want the original BSD500, click here.

Real-world noise removal

RealNoise-HKPolyU (paper)
RealNoise-test
This is the test-set used in our paper. It is generated by randomly cropping 10 HR samples of RealNoise-HKPolyU.

Test

Requirements

python 2.7
pytorch 0.3.1

Instructions

Download and un-zip the models, and put the trainedmodels in the project folder.
Download and put the datasets into the data folder. Please also set the names for a dataset and its sub-folder(s) correctly, according to the current data folder.
Go to the test folder, and run the scripts.

liujianzhao6328057 / dualresidualnetworks Goto Github PK