Designing a Multimodal Interface for Text Simplification: A Case Study on Deepfakes and Misinformation Mitigation

Francisco Lopes, Sílvia Araújo, Bruno Reynaud Sousa

2025

Abstract

The complexity of scientific literature often prevents non-experts from understanding science, limiting access to scientific knowledge for a broader audience. This paper presents a proof-of-concept system designed to enhance the accessibility of primary scientific literature through multimodal graphical abstracts (MGAs). The system simplifies complex content by integrating textual simplification, visual elements, and interactive components to support a broader range of learners. Using a case study on deepfake detection, the paper demonstrates the system’s functionalities. Key features include automated text simplification, audio narration, content summarization, and information visual representation. The example presented suggests the use of the generated MGA to improve AI literacy and misinformation resilience by promoting direct engagement with scientific content. Future work will focus on assessing the quality of text simplification and validating its effectiveness through user studies.

Paper Citation

in Harvard Style

Lopes F., Araújo S. and Sousa B. (2025). Designing a Multimodal Interface for Text Simplification: A Case Study on Deepfakes and Misinformation Mitigation. In Proceedings of the 17th International Conference on Computer Supported Education - Volume 1: EKM; ISBN 978-989-758-746-7, SciTePress, pages 737-742. DOI: 10.5220/0013513100003932

in Bibtex Style

@conference{ekm25,
author={Francisco Lopes and Sílvia Araújo and Bruno Sousa},
title={Designing a Multimodal Interface for Text Simplification: A Case Study on Deepfakes and Misinformation Mitigation},
booktitle={Proceedings of the 17th International Conference on Computer Supported Education - Volume 1: EKM},
year={2025},
pages={737-742},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013513100003932},
isbn={978-989-758-746-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Computer Supported Education - Volume 1: EKM
TI - Designing a Multimodal Interface for Text Simplification: A Case Study on Deepfakes and Misinformation Mitigation
SN - 978-989-758-746-7
AU - Lopes F.
AU - Araújo S.
AU - Sousa B.
PY - 2025
SP - 737
EP - 742
DO - 10.5220/0013513100003932
PB - SciTePress