loading
Documents

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Giuseppe Burtini ; Jason Loeppky and Ramon Lawrence

Affiliation: University of British Columbia, Canada

ISBN: 978-989-758-096-3

Keyword(s): Non-stationary and Restless Bandits, Multi-armed Bandits, Online Marketing, Web Optimization.

Related Ontology Subjects/Areas/Topics: Agents ; Artificial Intelligence ; Artificial Intelligence and Decision Support Systems ; Enterprise Information Systems ; Industrial Applications of Artificial Intelligence ; Intelligent Agents ; Internet Technology ; Strategic Decision Support Systems ; Web Information Systems and Technologies

Abstract: Restless bandits model the exploration vs. exploitation trade-off in a changing (non-stationary) world. Restless bandits have been studied in both the context of continuously-changing (drifting) and change-point (sudden) restlessness. In this work, we study specific classes of drifting restless bandits selected for their relevance to modelling an online website optimization process. The contribution in this work is a simple, feasible weighted least squares technique capable of utilizing contextual arm parameters while considering the parameter space drifting non-stationary within reasonable bounds. We produce a reference implementation, then evaluate and compare its performance in several different true world states, finding experimentally that performance is robust to time drifting factors similar to those seen in many real world cases.

PDF ImageFull Text

Download
Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 54.224.151.24

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Burtini G., Loeppky J. and Lawrence R. (2015). Improving Online Marketing Experiments with Drifting Multi-armed Bandits.In Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-096-3, pages 630-636. DOI: 10.5220/0005458706300636

@conference{iceis15,
author={Giuseppe Burtini and Jason Loeppky and Ramon Lawrence},
title={Improving Online Marketing Experiments with Drifting Multi-armed Bandits},
booktitle={Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2015},
pages={630-636},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005458706300636},
isbn={978-989-758-096-3},
}

TY - CONF

JO - Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Improving Online Marketing Experiments with Drifting Multi-armed Bandits
SN - 978-989-758-096-3
AU - Burtini G.
AU - Loeppky J.
AU - Lawrence R.
PY - 2015
SP - 630
EP - 636
DO - 10.5220/0005458706300636

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.