Improving Confidence in Experimental Systems through Automated Construction of Argumentation Diagrams

Clément Duffau, Cécile Camillieri, Mireille Blay-Fornarino

2017

Abstract

Experimental and critical systems are two universes that are more and more tangling together in domains such as bio-technologies or aeronautics. Verification, Validation and Accreditation (VV&A) processes are an everyday issue for these domains and the large scale of experiments needed to work out a system leads to overhead issues. All internal V&V has to be documented and traced to ensure that confidence in the produced system is good enough for accreditation organism. This paper presents and proposes a practical approach to automate the construction of argumentation systems based on empirical studies in order to represent the reasoning and improve confidence in such systems. We illustrate our approach with two use cases, one in the biomedical field and the other one in machine learning workflow domain.

References

  1. Balci, O. (2003). Verification, validation, and certification of modeling and simulation applications. In Proc. of the 35th Conf. on Winter Simulation: Driving Innovation.
  2. Basili, V. R., Caldiera, G., and Rombach, H. D. (1994). Experience factory. Encyclopedia of software engineering.
  3. Camillieri, C., Parisi, L., Blay-Fornarino, M., Precioso, F., Riveill, M., and Cancela Vaz, J. (2016). Towards a Software Product Line for Machine Learning Workflows: Focus on Supporting Evolution. In Proc. 10th Work. Model. Evol. co-located with ACM/IEEE 19th Int. Conf. Model Driven Eng. Lang. Syst. (MODELS).
  4. Chen, M., Ebert, D., Hagen, H., Laramee, R. S., van Liere, R., Ma, K.-L., Ribarsky, W., Scheuermann, G., and Silver, D. (2009). Data, information, and knowledge in visualization. IEEE Comput. Graph. Appl., 29.
  5. Kelly, T. and Weaver, R. (2004). The goal structuring notation-a safety argument notation. In Proc. of the dependable systems and networks 2004 workshop on assurance cases. Citeseer.
  6. Larrucea, X., Santamaría, I., and Colomo-Palacios, R. (2016). Assessing iso/iec29110 by means of itmark: results from an experience factory. Journal of Software: Evolution and Process, 28(11):969-980.
  7. Leyton-Brown, K., Nudelman, E., Andrew, G., McFadden, J., and Shoham, Y. (2003). A portfolio approach to algorithm select. In Proc. of the 18th Int. Joint Conference on Artificial Intelligence. Morgan Kaufmann Publishers Inc.
  8. Peldszus, A. and Stede, M. (2013). From argument diagrams to argumentation mining in texts: A survey. Int. Journal of Cognitive Informatics and Natural Intelligence.
  9. Polacsek, T. (2016). Validation, accreditation or certification: a new kind of diagram to provide confidence. In Research Challenges in Information Science. IEEE.
  10. Rech, J. and Ras, E. (2011). Aggregation of experiences in experience factories into software patterns. SIGSOFT.
  11. Rheinberger, H.-J. (1997). Toward a history of epistemic things: Synthesizing proteins in the test tube.
  12. Rus, I., Biffl, S., and Halling, M. (2002). Systematically combining process simulation and empirical data in support of decision analysis in software development. In Proc. of the 14th Int. Conf. on Software engineering and knowledge engineering.
  13. Toulmin, S. E. (2003). The uses of argument. Cambridge University Press.
  14. Vanschoren, J., Blockeel, H., Pfahringer, B., and Holmes, G. (2012). Experiment databases. Machine Learning.
  15. Wohlin, C., Runeson, P., H öst, M., Ohlsson, M. C., Regnell, B., and Wesslén, A. (2012). Experimentation in software engineering. Springer Science & Business Media.
  16. Wolpert, D. H. (1996). The lack of a priori distinctions between learning algorithms. Neural computation.
Download


Paper Citation


in Harvard Style

Duffau C., Camillieri C. and Blay-Fornarino M. (2017). Improving Confidence in Experimental Systems through Automated Construction of Argumentation Diagrams . In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-248-6, pages 495-500. DOI: 10.5220/0006358504950500


in Bibtex Style

@conference{iceis17,
author={Clément Duffau and Cécile Camillieri and Mireille Blay-Fornarino},
title={Improving Confidence in Experimental Systems through Automated Construction of Argumentation Diagrams},
booktitle={Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2017},
pages={495-500},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006358504950500},
isbn={978-989-758-248-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Improving Confidence in Experimental Systems through Automated Construction of Argumentation Diagrams
SN - 978-989-758-248-6
AU - Duffau C.
AU - Camillieri C.
AU - Blay-Fornarino M.
PY - 2017
SP - 495
EP - 500
DO - 10.5220/0006358504950500