GaSUM: A Genetic Algorithm Wrapped BERT for Text Summarization

Imen Tanfouri, Fethi Jarray, Fethi Jarray

2023

Abstract

Automatic Text Summarization (ATS) is a fundamental problem in natural language processing (NLP), it aims to reduce text size by removing irrelevant data and preserving the semantic structure of the original text. Recently, transformer-based models have shown great success in ATS and have been considered the state-of-the-art model for many NLP tasks. In this research, we are concerned with extractive summarization for a single document, where the goal is to extract a subset of sentences that best represents a summary of the document. We propose a combination of Bidirectional Encoder Representations from Transformers (BERT) and a Genetic Algorithm (GA) for automatic text summarization (named GaSUM) where GA is used as a search space method and BERT is used as a fitness measure. We validated these methods using the CNN/Daily Mail available dataset. Our results showed that GaSUM achieves a ROUGE-1 score of 55.75% and outperforms the state-of-the-art methods by a significant margin in terms of the rouge score.

Download


Paper Citation


in Harvard Style

Tanfouri I. and Jarray F. (2023). GaSUM: A Genetic Algorithm Wrapped BERT for Text Summarization. In Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-623-1, pages 447-453. DOI: 10.5220/0011893000003393


in Bibtex Style

@conference{icaart23,
author={Imen Tanfouri and Fethi Jarray},
title={GaSUM: A Genetic Algorithm Wrapped BERT for Text Summarization},
booktitle={Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2023},
pages={447-453},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011893000003393},
isbn={978-989-758-623-1},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - GaSUM: A Genetic Algorithm Wrapped BERT for Text Summarization
SN - 978-989-758-623-1
AU - Tanfouri I.
AU - Jarray F.
PY - 2023
SP - 447
EP - 453
DO - 10.5220/0011893000003393