Improving the Human-Likeness of Game AI’s Moves by Combining Multiple Prediction Models

Tatsuyoshi Ogawa, Chu-Hsuan Hsueh, Kokolo Ikeda

2023

Abstract

Strong game AI’s moves are sometimes strange or difficult for humans to understand. To achieve better human-computer interaction, researchers try to create human-like game AI. For chess and Go, supervised learning with deep neural networks is one of the most effective methods to predict human moves. In this study, we first show that supervised learning is also effective in Shogi (Japanese chess) to predict human moves. We also find that the AlphaZero-based model more accurately predicted moves of players with higher skill. We then investigate two evaluation metrics for measuring human-likeness, where one is move-matching accuracy that is often used in existing works, and the other is likelihood (the geometric mean of human moves’ probabilities predicted by the model). To create game AI that is more human-like, we propose two methods to combine multiple move prediction models. One uses a Classifier to select a suitable prediction model according to different situations, and the other is Blend that mixes probabilities from different prediction models because we observe that each model is good at some situations where other models cannot predict well. We show that the Classifier method increases the move-matching accuracy by 1%-3% but fails to improve the likelihood. The Blend method increases the move-matching accuracy by 3%-4% and the likelihood by 2%-5%.

Paper Citation

in Harvard Style

Ogawa T., Hsueh C. and Ikeda K. (2023). Improving the Human-Likeness of Game AI’s Moves by Combining Multiple Prediction Models. In Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART, ISBN 978-989-758-623-1, pages 931-939. DOI: 10.5220/0011804200003393

in Bibtex Style

@conference{icaart23,
author={Tatsuyoshi Ogawa and Chu-Hsuan Hsueh and Kokolo Ikeda},
title={Improving the Human-Likeness of Game AI’s Moves by Combining Multiple Prediction Models},
booktitle={Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,},
year={2023},
pages={931-939},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011804200003393},
isbn={978-989-758-623-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,
TI - Improving the Human-Likeness of Game AI’s Moves by Combining Multiple Prediction Models
SN - 978-989-758-623-1
AU - Ogawa T.
AU - Hsueh C.
AU - Ikeda K.
PY - 2023
SP - 931
EP - 939
DO - 10.5220/0011804200003393