Multi-Label Learning for Aspect Category Detection of Arabic Hotel Reviews Using AraBERT

Asma Ameur, Asma Ameur, Sana Hamdi, Sadok Ben Yahia

2023

Abstract

Studying people’s satisfaction with social media is vital to understanding the users’ needs. Nowadays, textual hotel reviews are used to evaluate the hotel’s e-reputation. In this context, we are interested in Aspect Category Detection (ACD) as a subtask of aspect-based sentiment analysis. This task needs to be investigated through multi-label classification, which is more challenging, in natural language processing, than single-label classification. Our study leverages the potential of transfer learning with the pre-trained AraBERT model for contextual text representation. We are based on the Arabic SemEval-2016 data set for hotel reviews. We propose a specific preprocessing for this Arabic reviews dataset to improve the performance. In addition, as this data suffers from an imbalanced distribution, we use a dynamically weighted loss function approach to deal with imbalanced classes. The carried-out results outperform the pioneering state-of-the-art of the Arabic ACD with an F1 score of 67:3%.

Paper Citation

in Harvard Style

Ameur A., Hamdi S. and Ben Yahia S. (2023). Multi-Label Learning for Aspect Category Detection of Arabic Hotel Reviews Using AraBERT. In Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-623-1, pages 241-250. DOI: 10.5220/0011694800003393

in Bibtex Style

@conference{icaart23,
author={Asma Ameur and Sana Hamdi and Sadok Ben Yahia},
title={Multi-Label Learning for Aspect Category Detection of Arabic Hotel Reviews Using AraBERT},
booktitle={Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2023},
pages={241-250},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011694800003393},
isbn={978-989-758-623-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Multi-Label Learning for Aspect Category Detection of Arabic Hotel Reviews Using AraBERT
SN - 978-989-758-623-1
AU - Ameur A.
AU - Hamdi S.
AU - Ben Yahia S.
PY - 2023
SP - 241
EP - 250
DO - 10.5220/0011694800003393