loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Daniel A. Braun and Pedro A. Ortega

Affiliation: University of Cambridge, United Kingdom

Keyword(s): Minimum relative entropy principle, Adaptive control, Bayesian control rule, Linear quadratic regulator.

Related Ontology Subjects/Areas/Topics: Adaptive Signal Processing and Control ; Informatics in Control, Automation and Robotics ; Information-Based Models for Control ; Signal Processing, Sensors, Systems Modeling and Control

Abstract: The design of optimal adaptive controllers is usually based on heuristics, because solving Bellman’s equations over information states is notoriously intractable. Approximate adaptive controllers often rely on the principle of certainty-equivalence where the control process deals with parameter point estimates as if they represented “true” parameter values. Here we present a stochastic control rule instead where controls are sampled from a posterior distribution over a set of probabilistic input-output models and the true model is identified by Bayesian inference. This allows reformulating the adaptive control problem as an inference and sampling problem derived from a minimum relative entropy principle. Importantly, inference and action sampling both work forward in time and hence such a Bayesian adaptive controller is applicable on-line. We demonstrate the improved performance that can be achieved by such an approach for linear quadratic regulator examples.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.91.176.3

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
A. Braun, D. and A. Ortega, P. (2010). A MINIMUM RELATIVE ENTROPY PRINCIPLE FOR ADAPTIVE CONTROL IN LINEAR QUADRATIC REGULATORS. In Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 3: ICINCO; ISBN 978-989-8425-02-7; ISSN 2184-2809, SciTePress, pages 103-108. DOI: 10.5220/0002938801030108

@conference{icinco10,
author={Daniel {A. Braun}. and Pedro {A. Ortega}.},
title={A MINIMUM RELATIVE ENTROPY PRINCIPLE FOR ADAPTIVE CONTROL IN LINEAR QUADRATIC REGULATORS},
booktitle={Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 3: ICINCO},
year={2010},
pages={103-108},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002938801030108},
isbn={978-989-8425-02-7},
issn={2184-2809},
}

TY - CONF

JO - Proceedings of the 7th International Conference on Informatics in Control, Automation and Robotics - Volume 3: ICINCO
TI - A MINIMUM RELATIVE ENTROPY PRINCIPLE FOR ADAPTIVE CONTROL IN LINEAR QUADRATIC REGULATORS
SN - 978-989-8425-02-7
IS - 2184-2809
AU - A. Braun, D.
AU - A. Ortega, P.
PY - 2010
SP - 103
EP - 108
DO - 10.5220/0002938801030108
PB - SciTePress