Comparing Conventional and Conversational Search Interaction Using Implicit Evaluation Methods

Abhishek Kaushik, Gareth J. F. Jones

2023

Abstract

Conversational search applications offer the prospect of improved user experience in information seeking via agent support. However, it is not clear how searchers will respond to this mode of engagement, in comparison to a conventional user-driven search interface, such as those found in a standard web search engine. We describe a laboratory-based study directly comparing user behaviour for a conventional search interface (CSI) with that of an agent-mediated multiview conversational search interface (MCSI) which extends the CSI. User reaction and search outcomes of the two interfaces are compared using implicit evaluation using five analysis methods: workload-related factors (NASA Load Task), psychometric evaluation for the software, knowledge expansion, user interactive experience and search satisfaction. Our investigation using scenario-based search tasks shows the MCSI to be more interactive and engaging, with users claiming to have a better search experience in contrast to a corresponding standard search interface.

Paper Citation

in Harvard Style

Kaushik A. and J. F. Jones G. (2023). Comparing Conventional and Conversational Search Interaction Using Implicit Evaluation Methods. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP; ISBN 978-989-758-634-7, SciTePress, pages 292-304. DOI: 10.5220/0011798500003417

in Bibtex Style

@conference{hucapp23,
author={Abhishek Kaushik and Gareth J. F. Jones},
title={Comparing Conventional and Conversational Search Interaction Using Implicit Evaluation Methods},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP},
year={2023},
pages={292-304},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011798500003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP
TI - Comparing Conventional and Conversational Search Interaction Using Implicit Evaluation Methods
SN - 978-989-758-634-7
AU - Kaushik A.
AU - J. F. Jones G.
PY - 2023
SP - 292
EP - 304
DO - 10.5220/0011798500003417
PB - SciTePress