REAL-TIME FACE SWAPPING IN VIDEO SEQUENCES - Magic Mirror

Nuri Murat Arar, Fatma Güney, Nasuh Kaan Bekmezci, Hua Gao, Hazım Kemal Ekenel

2012

Abstract

Magic Mirror is a face swapping tool that replaces the user’s face with a selected famous person’s face in a database. The system consists of a user interface from which the user can select one of the celebrities listed. Upon selection, model fitting automatically starts using the results of face detection and facial feature localization. Model fitting results in a set of points which describe the estimated shape of user’s face. By using the shape information, user’s face is replaced with the selected celebrity’s face. After some post processing for color and lighting adjustments are applied, final output is displayed to the user. The proposed system is able to run in real-time and generates satisfactory face swapping which can be applied for face de-identification in videos or other entertainment applications.

References

  1. Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P. N., and Nayar, S. K. (2008). Face swapping: Automatically replacing faces in photographs. ACM Transactions on Graphics, 27(3):1-8.
  2. Blanz, V., Scherbaum, K., Vetter, T., and Seidel, H.-P. (2004). Exchanging faces in images. Computer Graphics Forum, 23(3):669-676.
  3. Cootes, T., Edwards, G., and Taylor, C. (2001). Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6):681-685.
  4. Gao, H. (2008). Face registration with active appearance models for local appearance-based face recognition. Master thesis, Universität Karlsruhe.
  5. Gross, R., Matthews, I., and Baker, S. (2005). Generic vs. person specific active appearance models. Image Vision Computing, 23(11):1080-1093.
  6. Gross, R., Sweeney, L., Torre, F., and Baker, S. (2006). Model-based face de-identification. 22nd IEEE International Conference on Data Engineering, (ICDE), 27(3):161-168.
  7. Kublbeck, C. and Ernst, A. (2006). Face detection and tracking in video sequences using the modified census transformation. Image Vision Computing, 24(6):564- 572.
  8. Nordstrm, M. M., Larsen, M., Sierakowski, J., and Stegmann, M. B. (2004). The imm face database - an annotated dataset of 240 face images. Technical report, Technical University of Denmark.
Download


Paper Citation


in Harvard Style

Murat Arar N., Güney F., Kaan Bekmezci N., Gao H. and Kemal Ekenel H. (2012). REAL-TIME FACE SWAPPING IN VIDEO SEQUENCES - Magic Mirror . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-04-4, pages 48-53. DOI: 10.5220/0003828000480053


in Bibtex Style

@conference{visapp12,
author={Nuri Murat Arar and Fatma Güney and Nasuh Kaan Bekmezci and Hua Gao and Hazım Kemal Ekenel},
title={REAL-TIME FACE SWAPPING IN VIDEO SEQUENCES - Magic Mirror},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={48-53},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003828000480053},
isbn={978-989-8565-04-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)
TI - REAL-TIME FACE SWAPPING IN VIDEO SEQUENCES - Magic Mirror
SN - 978-989-8565-04-4
AU - Murat Arar N.
AU - Güney F.
AU - Kaan Bekmezci N.
AU - Gao H.
AU - Kemal Ekenel H.
PY - 2012
SP - 48
EP - 53
DO - 10.5220/0003828000480053