A Reinforcement Learning Environment for Directed Quantum Circuit Synthesis

Michael Kölle, Tom Schubert, Philipp Altmann, Maximilian Zorn, Jonas Stein, Claudia Linnhoff-Popien

2024

Abstract

With recent advancements in quantum computing technology, optimizing quantum circuits and ensuring reliable quantum state preparation have become increasingly vital. Traditional methods often demand extensive expertise and manual calculations, posing challenges as quantum circuits grow in qubit- and gate-count. Therefore, harnessing machine learning techniques to handle the growing variety of gate-to-qubit combinations is a promising approach. In this work, we introduce a comprehensive reinforcement learning environment for quantum circuit synthesis, where circuits are constructed utilizing gates from the the Clifford+T gate set to prepare specific target states. Our experiments focus on exploring the relationship between the depth of synthesized quantum circuits and the circuit depths used for target initialization, as well as qubit count. We organize the environment configurations into multiple evaluation levels and include a range of well-known quantum states for benchmarking purposes. We also lay baselines for evaluating the environment using Proximal Policy Optimization. By applying the trained agents to benchmark tests, we demonstrated their ability to reliably design minimal quantum circuits for a selection of 2-qubit Bell states.

Paper Citation

in Harvard Style

Kölle M., Schubert T., Altmann P., Zorn M., Stein J. and Linnhoff-Popien C. (2024). A Reinforcement Learning Environment for Directed Quantum Circuit Synthesis. In Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART; ISBN 978-989-758-680-4, SciTePress, pages 83-94. DOI: 10.5220/0012383200003636

in Bibtex Style

@conference{icaart24,
author={Michael Kölle and Tom Schubert and Philipp Altmann and Maximilian Zorn and Jonas Stein and Claudia Linnhoff-Popien},
title={A Reinforcement Learning Environment for Directed Quantum Circuit Synthesis},
booktitle={Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART},
year={2024},
pages={83-94},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012383200003636},
isbn={978-989-758-680-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART
TI - A Reinforcement Learning Environment for Directed Quantum Circuit Synthesis
SN - 978-989-758-680-4
AU - Kölle M.
AU - Schubert T.
AU - Altmann P.
AU - Zorn M.
AU - Stein J.
AU - Linnhoff-Popien C.
PY - 2024
SP - 83
EP - 94
DO - 10.5220/0012383200003636
PB - SciTePress