The presence of noise in videos affects subsequent image processing phases, such as three dimensional reconstruction, registration, classification of objects, motion segmentation and
analysis, tracking, identification and recognition of humans. Thus, denoising is an extremely
important pre-processing phase that is used to improve the perceptual appearance of images;
however, a trade-off between noise reduction and data preservation is important to enhance
the characteristics of images that are relevant for high level algorithms
1) Implement the robust bilateral and temporal filter (RBLT) for denoising a video sequence.
Spatial and temporal components are incorporated into the filter formulation, which increases
the filter's ability to remove strong noise components. Consider the Geman-Mcclure or the
Charbonnier as error norms for M-Estimators.
2) Consider the following evaluation metrics to assess the quality of your implementation:
- SIIM
- PNSR
The original image (distortion-free or reference), must be compared to the distorted image,
using these two evaluation metrics. The distorted image is obtained by corrupting the original
image with a distinct noise configuration (Salt-Pepper and Gaussian Noise) and then, the image
sample is filtered by each filter, individually. The level of noise that should be added to each
original image is 20 to 40 of standard deviation for Gaussian noise and 10 to 30% for the SaltPepper noise. Results must be provided graphically.
3) Discuss the results by taking into consideration the median and Gaussian filter. You can also
consider the following paper: Andry et al. (2013), Enhancing dynamic videos for surveillance and
robotic applications: The robust bilateral and temporal filter, Signal Processing: Image
Communication, Elsevier, 2014.
4) Consider the image sequences for this project and estimate the optical flow using these two
techniques. Produce two videos per image sequence showing the magnitude and orientation of
the flow using the color scheme presented in the lectures. Discuss the results obtained.
Image sequences for this project:
- mlky_6
- 210329_06A_Bali_4k_004
- Saint_Barthelemy_2