loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Development and Preliminary Evaluation of a Technology for Assessing Hedonic Aspects of UX in Text-Based Chatbots

Topics: Autonomous Agents & Multi-Agent Systems; Big Data, Data Science and Analytics; Design and Evaluation; Emotional and Affective Computing; Human Factors; Intelligent Agents; Interface Design; Machine Learning in HCI; Natural Language Interfaces to Intelligent Systems; Performance Evaluation and Benchmarking; User Experience

Authors: Pamella A. de L. Mariano 1 ; Ana Paula Chaves 2 and Natasha Valentim 1

Affiliations: 1 Federal University of Paraná, Curitiba, Brazil ; 2 Northern Arizona University, Flagstaff, U.S.A.

Keyword(s): Chatbot, Evaluation, Hedonic Aspects, User Experience.

Abstract: For text-based chatbots to achieve a desired level of quality, it is essential to evaluate their performance, particularly focusing on the hedonic aspects of User Experience (UX), which is a crucial quality attribute. A comprehensive evaluation must consider the specifics of the context being assessed. A Systematic Mapping Study (SMS) revealed that no existing UX evaluation technologies address the hedonic aspects of UX in text-based chatbots. The Guidelines to Assess Hedonic Aspects in Chatbots (GAHAC) was developed to address this gap. The guidelines were formulated by selecting and evaluating the hedonic aspects of UX and the evaluation technologies identified in the SMS. Relevant questions from these technologies were filtered and adapted to the context of text-based chatbots. GAHAC aims to provide a context-specific evaluation technology in the form of guidelines encompassing the hedonic aspects of UX. Its primary contribution is providing a structured and accessible method for evaluating hedonic aspects, which have been largely overlooked in UX studies of text-based chatbots. This enables developers and researchers to qualitatively identify opportunities to improve UX in chatbot interactions. A preliminary evaluation conducted with two Human-Computer Interaction experts led to refinements in the guidelines. By offering a dedicated UX evaluation technology for text-based chatbots, GAHAC contributes to improving the quality of such systems. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 216.73.216.68

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Mariano, P. A. L., Chaves, A. P. and Valentim, N. (2025). Development and Preliminary Evaluation of a Technology for Assessing Hedonic Aspects of UX in Text-Based Chatbots. In Proceedings of the 27th International Conference on Enterprise Information Systems - Volume 2: ICEIS; ISBN 978-989-758-749-8; ISSN 2184-4992, SciTePress, pages 544-551. DOI: 10.5220/0013289200003929

@conference{iceis25,
author={Pamella A. de L. Mariano and Ana Paula Chaves and Natasha Valentim},
title={Development and Preliminary Evaluation of a Technology for Assessing Hedonic Aspects of UX in Text-Based Chatbots},
booktitle={Proceedings of the 27th International Conference on Enterprise Information Systems - Volume 2: ICEIS},
year={2025},
pages={544-551},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013289200003929},
isbn={978-989-758-749-8},
issn={2184-4992},
}

TY - CONF

JO - Proceedings of the 27th International Conference on Enterprise Information Systems - Volume 2: ICEIS
TI - Development and Preliminary Evaluation of a Technology for Assessing Hedonic Aspects of UX in Text-Based Chatbots
SN - 978-989-758-749-8
IS - 2184-4992
AU - Mariano, P.
AU - Chaves, A.
AU - Valentim, N.
PY - 2025
SP - 544
EP - 551
DO - 10.5220/0013289200003929
PB - SciTePress