loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Bernardo Leite 1 ; 2 and Henrique Cardoso 1 ; 2

Affiliations: 1 Faculty of Engineering of the University of Porto (FEUP), Portugal ; 2 Artificial Intelligence and Computer Science Laboratory (LIACC), Portugal

Keyword(s): Natural Language Processing, Question Generation, Evaluation.

Abstract: The task of Question Generation (QG) has attracted the interest of the natural language processing community in recent years. QG aims to automatically generate well-formed questions from an input (e.g., text), which can be especially relevant for computer-supported educational platforms. Recent work relies on large-scale question-answering (QA) datasets (in English) to train and build the QG systems. However, large-scale quality QA datasets are not widely available for lower-resourced languages. In this respect, this research addresses the task of QG in a lower-resourced language — Portuguese — using a traditional rule-based approach for generating wh-questions. We perform a feasibility analysis of the approach through a comprehensive evaluation supported by two studies: (1) comparing the similarity between machine-generated and human-authored questions using automatic metrics, and (2) comparing the perceived quality of machine-generated questions to those elaborated by humans. Altho ugh the results show that rule-based generated questions fall short in quality compared to those authored by humans, they also suggest that a rule-based approach remains a feasible alternative to neural-based techniques when these are not viable. The code is publicly available at https://github.com/bernardoleite/question-generation-portuguese. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 13.59.82.167

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Leite, B. and Cardoso, H. (2023). Do Rules Still Rule? Comprehensive Evaluation of a Rule-Based Question Generation System. In Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU; ISBN 978-989-758-641-5; ISSN 2184-5026, SciTePress, pages 27-38. DOI: 10.5220/0011852100003470

@conference{csedu23,
author={Bernardo Leite. and Henrique Cardoso.},
title={Do Rules Still Rule? Comprehensive Evaluation of a Rule-Based Question Generation System},
booktitle={Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU},
year={2023},
pages={27-38},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011852100003470},
isbn={978-989-758-641-5},
issn={2184-5026},
}

TY - CONF

JO - Proceedings of the 15th International Conference on Computer Supported Education - Volume 2: CSEDU
TI - Do Rules Still Rule? Comprehensive Evaluation of a Rule-Based Question Generation System
SN - 978-989-758-641-5
IS - 2184-5026
AU - Leite, B.
AU - Cardoso, H.
PY - 2023
SP - 27
EP - 38
DO - 10.5220/0011852100003470
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic