Towards High-Quality Parallel Stabilization

Abdelrahman Ahmed, Mohamed S. Shehata

2016

Abstract

With the widespread use of handheld devices and unmanned aerial vehicles (UAVs) that has the ability to record video sequences. Digital video stabilization becomes more important as these sequences are usually shaky undermining the visual quality of the video. Digital video stabilization has been studied for decades yielding an extensive amount of literature in the field. However, most of them are highly sequential. In this paper, we present a new parallel technique that exploits the parallel architecture found in modern day devices. The algorithm divides the frame into blocks and estimates a camera path for each block to better enhance the estimation of the transformation needed to adjust for the shakiness of the video.

References

  1. Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S. M., and Szeliski, R. (2011). Building rome in a day.
  2. Buehler, C., Bosse, M., and McMillan, L. (2001). Nonmetric image-based rendering for video stabilization. In Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, volume 2, pages II-609. IEEE.
  3. Furukawa, Y., Curless, B., Seitz, S. M., and Szeliski, R. (2010). Towards internet-scale multi-view stereo. In Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, pages 1434-1441. IEEE.
  4. Goldstein, A. and Fattal, R. (2012). Video stabilization using epipolar geometry. ACM Transactions on Graphics (TOG), 31(5):126.
  5. Grundmann, M., Kwatra, V., and Essa, I. (2011). Autodirected video stabilization with robust l1 optimal camera paths. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 225- 232. IEEE.
  6. Irani, M. (2002). Multi-frame correspondence estimation using subspace constraints. International Journal of Computer Vision, 48(3):173-194.
  7. Irani, M., Rousso, B., and Peleg, S. (1994). Recovery of ego-motion using image stabilization. In Computer Vision and Pattern Recognition, 1994. Proceedings CVPR'94., 1994 IEEE Computer Society Conference on, pages 454-460. IEEE.
  8. Jiang, N., Tan, P., and Cheong, L.-F. (2012). Seeing double without confusion: Structure-from-motion in highly ambiguous scenes. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 1458-1465. IEEE.
  9. Litvin, A., Konrad, J., and Karl, W. C. (2003). Probabilistic video stabilization using kalman filtering and mosaicing. In Electronic Imaging 2003, pages 663-674. International Society for Optics and Photonics.
  10. Liu, F., Gleicher, M., Jin, H., and Agarwala, A. (2009). Content-preserving warps for 3d video stabilization. In ACM Transactions on Graphics (TOG), volume 28, page 44. ACM.
  11. Liu, F., Gleicher, M., Wang, J., Jin, H., and Agarwala, A. (2011). Subspace video stabilization. ACM Transactions on Graphics (TOG), 30(1):4.
  12. Liu, F., Niu, Y., and Jin, H. (2013). Joint subspace stabilization for stereoscopic video. In Computer Vision (ICCV), 2013 IEEE International Conference on, pages 73-80. IEEE.
  13. Liu, S., Wang, Y., Yuan, L., Bu, J., Tan, P., and Sun, J. (2012). Video stabilization with a depth camera. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on, pages 89-95. IEEE.
  14. Matsushita, Y., Ofek, E., Ge, W., Tang, X., and Shum, H.-Y. (2006). Full-frame video stabilization with motion inpainting. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 28(7):1150-1163.
  15. Morimoto, C. and Chellappa, R. (1998). Evaluation of image stabilization algorithms. In Acoustics, Speech and Signal Processing, 1998. Proceedings of the 1998 IEEE International Conference on, volume 5, pages 2789-2792. IEEE.
  16. Shi, J. and Tomasi, C. (1994). Good features to track. In Computer Vision and Pattern Recognition, 1994. Proceedings CVPR'94., 1994 IEEE Computer Society Conference on, pages 593-600. IEEE.
  17. Triggs, B., McLauchlan, P. F., Hartley, R. I., and Fitzgibbon, A. W. (2000). Bundle adjustmenta modern synthesis. In Vision algorithms: theory and practice, pages 298- 372. Springer.
  18. Wang, Y., Hou, Z., Leman, K., and Chang, R. (2011). Realtime video stabilization for unmanned aerial vehicles. In MVA, pages 336-339.
  19. Wang, Y.-S., Liu, F., Hsu, P.-S., and Lee, T.-Y. (2013). Spatially and temporally optimized video stabilization. Visualization and Computer Graphics, IEEE Transactions on, 19(8):1354-1361.
  20. Wu, C. (2013). Towards linear-time incremental structure from motion. In 3D Vision-3DV 2013, 2013 International Conference on, pages 127-134. IEEE.
Download


Paper Citation


in Harvard Style

Ahmed A. and S. Shehata M. (2016). Towards High-Quality Parallel Stabilization . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 665-670. DOI: 10.5220/0005765306650670


in Bibtex Style

@conference{visapp16,
author={Abdelrahman Ahmed and Mohamed S. Shehata},
title={Towards High-Quality Parallel Stabilization},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={665-670},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005765306650670},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - Towards High-Quality Parallel Stabilization
SN - 978-989-758-175-5
AU - Ahmed A.
AU - S. Shehata M.
PY - 2016
SP - 665
EP - 670
DO - 10.5220/0005765306650670