The Winograd Schema Challenge: Are You Sure That We Are on the Right Track?

Nicos Isaak, Nicos Isaak

2022

Abstract

In the past few years, the Winograd Schema Challenge (WSC), the task of resolving ambiguities in carefully- structured sentences, has received considerable interest. According to Levesque, what matters when it comes to the WSC is not a good semblance of intelligent behavior but the behavior itself. In this regard, the WSC has been proposed to understand human behavior as a challenge that could lead to the endowment of machines with commonsense reasoning abilities. Here, we argue that most systems developed so far have typically been designed and evaluated without considering the challenge’s purpose, emphasizing the semblance of intelligence rather than understanding human behavior itself. At the same time, we present an overview of systems developed so far along with a novel developmental-evaluation framework (WSC-Framework 01). The WSC-Framework offers guidelines on what we might need to do to move the field towards the endowment of machines with commonsense reasoning to tackle Winograd schemas the way humans do.

Paper Citation

in Harvard Style

Isaak N. (2022). The Winograd Schema Challenge: Are You Sure That We Are on the Right Track?. In Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART, ISBN 978-989-758-547-0, pages 881-888. DOI: 10.5220/0010923200003116

in Bibtex Style

@conference{icaart22,
author={Nicos Isaak},
title={The Winograd Schema Challenge: Are You Sure That We Are on the Right Track?},
booktitle={Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,},
year={2022},
pages={881-888},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010923200003116},
isbn={978-989-758-547-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,
TI - The Winograd Schema Challenge: Are You Sure That We Are on the Right Track?
SN - 978-989-758-547-0
AU - Isaak N.
PY - 2022
SP - 881
EP - 888
DO - 10.5220/0010923200003116