loading
Papers

Research.Publish.Connect.

Paper

Authors: João Freitas 1 ; Nuno Lavado 1 and Jorge Bernardino 2

Affiliations: 1 Coimbra Polytechnic – ISEC, Rua Pedro Nunes, 3030-199 Coimbra and Portugal ; 2 Coimbra Polytechnic – ISEC, Rua Pedro Nunes, 3030-199 Coimbra, Portugal, CISUC - Centre of Informatics and Systems of University of Coimbra, DEI, Polo 2, 3030-290 Coimbra and Portugal

ISBN: 978-989-758-318-6

Keyword(s): Data Science, Machine Learning, AutoML, Auto-WEKA, OpenML, Benchmarking.

Related Ontology Subjects/Areas/Topics: Business Analytics ; Data Engineering ; Predictive Modeling

Abstract: Machine Learning model building is an important and complex task in Data Science but also a good target for automation as recently exploited by AutoML. In general, free and open-source packages offer a joint space of learning algorithms and their respective hyperparameter settings and an optimization method for model search and tuning. In this paper, Auto-WEKA’s performance has been tested by running it for short periods of time (5, 15 and 30 minutes) using a commodity machine and suitable datasets with a limited number of observations and features. Benchmarking was performed against the best human-generated solution available in OpenML for each selected dataset. We concluded that increasing the overall time budget available over the previous values didn’t improve significantly classifiers’ performance.

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.81.29.226

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Freitas, J.; Lavado, N. and Bernardino, J. (2018). Benchmarking Auto-WEKA on a Commodity Machine.In Proceedings of the 7th International Conference on Data Science, Technology and Applications - Volume 1: DATA, ISBN 978-989-758-318-6, pages 180-186. DOI: 10.5220/0006914801800186

@conference{data18,
author={João Freitas. and Nuno Lavado. and Jorge Bernardino.},
title={Benchmarking Auto-WEKA on a Commodity Machine},
booktitle={Proceedings of the 7th International Conference on Data Science, Technology and Applications - Volume 1: DATA,},
year={2018},
pages={180-186},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006914801800186},
isbn={978-989-758-318-6},
}

TY - CONF

JO - Proceedings of the 7th International Conference on Data Science, Technology and Applications - Volume 1: DATA,
TI - Benchmarking Auto-WEKA on a Commodity Machine
SN - 978-989-758-318-6
AU - Freitas, J.
AU - Lavado, N.
AU - Bernardino, J.
PY - 2018
SP - 180
EP - 186
DO - 10.5220/0006914801800186

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.