loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Ebert Theeuwes 1 ; Gabriele Venturato 1 and Gavin Rens 2

Affiliations: 1 KU Leuven, Dept. of Computer Science, B-3000 Leuven, Belgium ; 2 Computer Science Division, Stellenbosch University, Stellenbosch, South Africa

Keyword(s): Partially Observable Markov Decision Processes, Monte Carlo Tree Search, Locality-Sensitive Hashing, Transposition Nodes, Belief Re-Use.

Abstract: Partially observable Markov decision processes (POMDPs) require agents to make decisions with incomplete information, facing challenges like an exponential growth in belief states and action-observation histories. Monte Carlo tree search (MCTS) is commonly used for this, but it redundantly evaluates identical states reached through different action sequences. We propose Belief Re-use in Online Partially Observable Planning (BROPOP), a technique that transforms the MCTS tree into a graph by merging nodes with similar beliefs. Using a POMDP-specific locality-sensitive hashing method, BROPOP efficiently identifies and reuses belief nodes while preserving information integrity through update-descent backpropagation. Experiments on standard benchmarks show that BROPOP enhances reward performance with controlled computational cost.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.140.198.85

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Theeuwes, E., Venturato, G. and Rens, G. (2025). Belief Re-Use in Partially Observable Monte Carlo Tree Search. In Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART; ISBN 978-989-758-737-5; ISSN 2184-433X, SciTePress, pages 634-645. DOI: 10.5220/0013265200003890

@conference{icaart25,
author={Ebert Theeuwes and Gabriele Venturato and Gavin Rens},
title={Belief Re-Use in Partially Observable Monte Carlo Tree Search},
booktitle={Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART},
year={2025},
pages={634-645},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013265200003890},
isbn={978-989-758-737-5},
issn={2184-433X},
}

TY - CONF

JO - Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART
TI - Belief Re-Use in Partially Observable Monte Carlo Tree Search
SN - 978-989-758-737-5
IS - 2184-433X
AU - Theeuwes, E.
AU - Venturato, G.
AU - Rens, G.
PY - 2025
SP - 634
EP - 645
DO - 10.5220/0013265200003890
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic