loading
Papers Papers/2020

Research.Publish.Connect.

Paper

Author: Łukasz Radliński

Affiliation: Faculty of Computer Science and Information Technology, West Pomeranian University of Technology in Szczecin, ul. Żołnierska 49, 71-210 Szczecin, Poland

ISBN: 978-989-758-421-3

ISSN: 2184-4895

Keyword(s): User Satisfaction, Software Projects, Prediction Models, Machine Learning, ISBSG.

Abstract: User satisfaction is an important aspect of software quality. Factors of user satisfaction and its impact on project success were analysed in various studies. However, very few studies investigated the ability to predict user satisfaction. This paper presents results of such challenge. The analysis was performed with the ISBSG dataset of software projects. The target variable, satisfaction score, was defined as a sum of eight variables reflecting different aspects of user satisfaction. Twelve machine learning algorithms were used to build 40 predictive models. Each model was evaluated on 20 passes with a test subset. On average, a random forest model with missing data imputation by mode and mean achieved the best performance with the macro mean absolute error of 1.88. Four variables with the highest importance on predictions for this model are: survey respondent role, log(effort estimate), log(summary work effort), and proportion of major defects. On average 14 models performed worse than a simple baseline model. While best performing models deliver predictions with satisfactory accuracy, high variability of performance between different model variants was observed. Thus, a careful selection of model settings is required when attempting to use such model in practise. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 35.170.64.36

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Radliński, Ł. (2020). Predicting User Satisfaction in Software Projects using Machine Learning Techniques. In Proceedings of the 15th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE, ISBN 978-989-758-421-3 ISSN 2184-4895, pages 374-381. DOI: 10.5220/0009391803740381

@conference{enase20,
author={Łukasz Radliński.},
title={Predicting User Satisfaction in Software Projects using Machine Learning Techniques},
booktitle={Proceedings of the 15th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE,},
year={2020},
pages={374-381},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009391803740381},
isbn={978-989-758-421-3},
issn={2184-4895},
}

TY - CONF

JO - Proceedings of the 15th International Conference on Evaluation of Novel Approaches to Software Engineering - ENASE,
TI - Predicting User Satisfaction in Software Projects using Machine Learning Techniques
SN - 978-989-758-421-3
IS - 2184-4895
AU - Radliński, Ł.
PY - 2020
SP - 374
EP - 381
DO - 10.5220/0009391803740381

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.