Facial Paralysis Recognition Using Face Mesh-Based Learning

Zeerak Baig, Dustin van der Haar

2023

Abstract

Facial paralysis is a medical disorder caused by a compressed or enlarged seventh cranial nerve. The facial muscles become weak or paralysed because of the compression. Many medical experts believe that viral infection is the most common cause of facial paralysis; however, the origin of nerve injury is unknown. Facial paralysis hampers a patient’s ability to blink, swallow, or communicate. This article proposes deep learningbased and traditional machine learning-based approaches for facial paralysis recognition in facial images, which can aid in developing standardised medical evaluation tools. The proposed method first detects faces or faces in each image, then extracts a face mesh from the given image using Google’s Mediapipe. The face mesh descriptors are then transformed into a novel face mesh image, fed into the final component, comprised of a convolutional neural network (CNN) to perform overall predictions. The study uses YouTube facial paralysis datasets (Youtube and Stroke face) and control datasets (CK+ and TUFTS face) to train and test the model for unhealthy patients. The best approach achieved an accuracy of 98.93% with a MobilenetV2 backbone using the YouTube facial paralysis dataset and the Stroke face dataset for palsy images, thereby showing mesh learning can be accomplished using a CNN.

Paper Citation

in Harvard Style

Baig Z. and van der Haar D. (2023). Facial Paralysis Recognition Using Face Mesh-Based Learning. In Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-626-2, pages 881-888. DOI: 10.5220/0011682900003411

in Bibtex Style

@conference{icpram23,
author={Zeerak Baig and Dustin van der Haar},
title={Facial Paralysis Recognition Using Face Mesh-Based Learning},
booktitle={Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2023},
pages={881-888},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011682900003411},
isbn={978-989-758-626-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Facial Paralysis Recognition Using Face Mesh-Based Learning
SN - 978-989-758-626-2
AU - Baig Z.
AU - van der Haar D.
PY - 2023
SP - 881
EP - 888
DO - 10.5220/0011682900003411