Schema-guided Testing of Message-oriented Systems

André Santos, André Santos, Alcino Cunha, Nuno Macedo

2022

Abstract

Effective testing of message-oriented software requires describing the expected behaviour of the system and the causality relations between messages. This is often achieved with formal specifications based on temporal logics that require both first-order and metric temporal constructs – to specify constraints over data and real time. This paper proposes a technique to automatically generate tests for metric first-order temporal specifications that match well-understood specification patterns. Our approach takes in properties in a high-level specification language and identifies test schemas (strategies) that are likely to falsify the property. Schemas correspond to abstract classes of execution traces, that can be refined by introducing assumptions about the system. At the low level, concrete traces are successively produced for each schema using property-based testing principles. We instantiate this approach for a popular robotic middleware, ROS, and evaluate it on two systems, showing that schema-based test generation is effective for message-oriented software.

Paper Citation

in Harvard Style

Santos A., Cunha A. and Macedo N. (2022). Schema-guided Testing of Message-oriented Systems. In Proceedings of the 17th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-758-568-5, pages 26-37. DOI: 10.5220/0010976100003176

in Bibtex Style

@conference{enase22,
author={André Santos and Alcino Cunha and Nuno Macedo},
title={Schema-guided Testing of Message-oriented Systems},
booktitle={Proceedings of the 17th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,},
year={2022},
pages={26-37},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010976100003176},
isbn={978-989-758-568-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,
TI - Schema-guided Testing of Message-oriented Systems
SN - 978-989-758-568-5
AU - Santos A.
AU - Cunha A.
AU - Macedo N.
PY - 2022
SP - 26
EP - 37
DO - 10.5220/0010976100003176