Denoising of Noisy and Compressed Video Sequences

A. Buades, J. L. Lisani

2017

Abstract

A novel denoising algorithm is presented for video sequences. The proposed approach takes advantage of the self similarity and redundancy of adjacent frames. The algorithm automatically estimates a signal dependent noise model for each level of a multi-scale pyramid. A variance stabilization transform is applied at each scale and a novel sequence denoising algorithm is used. Experiments show that the new algorithm is able to correctly remove highly correlated noise from dark and compressed movie sequences. Particularly, we illustrate the performance with indoor and lowlight scenes acquired with mobile phones.

References

  1. Boulanger, J., Kervrann, C., and Bouthemy, P. (2007). Space-time adaptation for patch-based image sequence restoration. IEEE Trans. PAMI, 29(6):1096- 1102.
  2. Buades, A., Coll, B., and Morel, J. (2011). Self-similaritybased image denoising. Communications of the ACM, 54(5):109-117.
  3. Buades, A., Lisani, J., and Miladinovic, M. (2016). Patch Based Video Denoising with Optical Flow Estimation. IEEE Transactions on Image Processing, 25(6).
  4. Colom, M., Buades, A., and Morel, J.-M. (2014). Nonparametric noise estimation method for raw images. JOSA A, 31(4):863-871.
  5. Dabov, K., Foi, A., Katkovnik, V., and Egiazarian, K. (2007). Image denoising by sparse 3D transformdomain collaborative filtering. IEEE Transactions on image processing, 16:2007.
  6. Dabov, K., Foi, A., Katkovnik, V., Egiazarian, K., et al. (2009). Bm3d image denoising with shape-adaptive principal component analysis. Proc. of the Workshop on Signal Processing with Adaptive Sparse Structured Representations, Saint-Malo, France.
  7. Drago, F., Myszkowski, K., Annen, T., and Chiba, N. (2003). Adaptive logarithmic mapping for displaying high contrast scenes. In Proceedings of EUROGRAPHICS, volume 22.
  8. Lebrun, M., Buades, A., and Morel, J.-M. (2013). A nonlocal bayesian image denoising algorithm. SIAM Journal on Imaging Sciences, 6(3):1665-1688.
  9. Liu, C., Szeliski, R., Kang, S., Zitnick, C., and Freeman, W. (2008). Automatic estimation and removal of noise from a single image. IEEE transactions on pattern analysis and machine intelligence, 30(2):299-314.
  10. Lou, Y., Zhang, X., Osher, S., and Bertozzi, A. (2010). Image recovery via nonlocal operators. Journal of Scientific Computing , 42(2):185-197.
  11. Maggioni, M., Boracchi, G., Foi, A., and Egiazarian, K. (2011). Video denoising using separable 4D nonlocal spatiotemporal transforms. In IS&T/SPIE Electronic Imaging, pages 787003-787003. International Society for Optics and Photonics.
  12. Orchard, J., Ebrahimi, M., and Wong, A. (2008). Efficient Non-Local-Means Denoising using the SVD. In Proceedings of The IEEE International Conference on Image Processing.
  13. Ponomarenko, N. N., Lukin, V. V., Zriakhov, M. S., Kaarna, A., and Astola, J. T. (2007). An automatic approach to lossy compression of AVIRIS images. IEEE International Geoscience and Remote Sensing Symposium.
  14. Tomasi, C. and Manduchi, R. (1998). Bilateral filtering for gray and color images. In Computer Vision, 1998. Sixth International Conference on, pages 839-846.
  15. Zhang, L., Dong, W., Zhang, D., and Shi, G. (2010). Twostage image denoising by principal component analysis with local pixel grouping. Pattern Recognition, 43(4):1531-1549.
Download


Paper Citation


in Harvard Style

Buades A. and Lisani J. (2017). Denoising of Noisy and Compressed Video Sequences . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-225-7, pages 150-157. DOI: 10.5220/0006101501500157


in Bibtex Style

@conference{visapp17,
author={A. Buades and J. L. Lisani},
title={Denoising of Noisy and Compressed Video Sequences},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={150-157},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006101501500157},
isbn={978-989-758-225-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)
TI - Denoising of Noisy and Compressed Video Sequences
SN - 978-989-758-225-7
AU - Buades A.
AU - Lisani J.
PY - 2017
SP - 150
EP - 157
DO - 10.5220/0006101501500157