Authors:
Tilahun Yeshambel
1
;
Josiane Mothe
2
and
Yaregal Assabie
3
Affiliations:
1
IT Doctorial Program, Addis Ababa University, Addis Ababa, Ethiopia
;
2
INSPE, Univ. de Toulouse, IRIT, UMR5505 CNRS, Toulouse, France
;
3
Department of Computer Science, Addis Ababa University, Addis Ababa, Ethiopia
Keyword(s):
Query Performance Prediction, Feature Analysis, Amharic, Adhoc Search, IR Models, Correlation.
Abstract:
Query performance prediction (QPP) is the task of evaluating the quality of retrieval results of a query within the context of a retrieval model. Although several research activities have been carried out on QPP for many languages, query performance predictors are not studied yet for Amharic adhoc information retrieval (IR) task. In this paper, we present the effect of various IR models on Amharic queries, and make some analysis on the computed features for QPP methods from both Indri and Terrier indexes based on the Amharic Adhoc Information Retrieval Test Collection (2AIRTC). We conducted various experiments to attest the quality of Amharic queries and performance of IR models on 2AIRTC which is TREC-like test collection. The correlation degree between predictors is used to measure the dependence between various query performance predictors, or between a predictor and a retrieval score. Our finding shows that Jelinek-Mercer model outperformed the BM25 and Dirichlet models. The find
ing also indicates the correlation matrices between the query-IDF predictors and the evaluation measures show very low Pearson correlation coefficient values.
(More)