A Preliminary Mapping Study of Software Metrics Thresholds

Elisabetta Ronchieri, Marco Canaparo


Many papers deal with the topic of thresholds in software metrics to determine the quality level of a software project. This paper aims to identify the status of influential software metrics thresholds papers. We use search facilities in the SCOPUS Web tool to establish the cited papers published from 1970 to 2015. We classified the selected papers according to different factors, such as the main topic and the general type. The cited papers were more frequently on journals than conference proceedings. We observed three main problems: an unclear explanation of the method for selecting the technique that calculates thresholds; a direct application of the metric threshold values to different code context; a lack of objective analysis for the calculated thresholds. To our knowledge, this paper is the only one that performs this kind of study. It can provide baselines to assist new research and development efforts. Due to the page limit, this paper contains a summary of the results.


  1. Al Dallal, J. (2012). Constructing models for predicting extract subclass refactoring opportunities using objectoriented quality metrics. Information and Software Technology, 54:1125-1141.
  2. Alves, T. L., Ypma, C., and Visser, J. (2010). Deriving metrics thresholds from benchmark data. In The IEEE International Conference on Software Maintenance, pages 1-10.
  3. Aman, H., Mochiduki, N., Yamada, H., and Noda, M.-T. (2005). A simple predictive method for discriminating costly classes using class size metric. IEICE Transaction on Information and Systems, E88-D(6).
  4. Ampatzoglou, A., Frantzeskou, G., and Stamelos, I. (2011). A methodology to assess the impact of design patterns on software quality. Information and Software Technology, 54:331-346.
  5. Barkmann, H., Lincke, R., and Love, W. (2009). Quantitative evaluation of software quality metrics in opensource projects. In International Conference on Advanced Information Networking and Applications Workshops, pages 1067 - 1072. IEEE.
  6. Brito e Abreu, F. and Carapuca, R. (1994). Object-oriented software engineering: Measuring and controlling the development process. In 4th Int. Conf. on Software Quality QSIC.
  7. Chidamber, S. R. and Kamerer, C. F. (1994). A metrics suite for object-oriented design. IEEE Trans. Software Engineering, SE-20(6):476-493.
  8. El Emam, K., Benlarbi, S., Goel, N., Melo, W., Lounis, H., and Rai, S. (2002). The optimal class size for objectoriented software. IEEE Transactions on Software Engineering, 28.
  9. Fenton, N. and Bieman, J. (2014). Software Metrics: A Rigorous and Practical Approach, Third Edition. CRC Press.
  10. Fenton, N. E. and Neil, M. (2000). Software metrics: roadmap. ICSE - Future of SE Track, pages 357-370.
  11. Ferreira, K. A. M., Bigonha, M. A. S., Bigonha, R. S., Mendes, L. F. O., and Almeida, H. C. (2012). Identifying thresholds for object-oriented software metrics. Journal of Systems and Software, 85(2):244-257.
  12. Kitchenham, B. A. and Charters, S. M. (2007). Guidelines for performing systematic literature reviews in software engineering. EBSE Technical Report EBSE2007-01, Keele University and Durham University.
  13. Kitchenham, B. A., Dyba, T., and Jorgensen, M. (2004). Evidence-based software engineering. In The 26th International Conference on Software Engineering (ICSE'04).
  14. Lorentz, M. and Kidd, J. (1994). Object-oriented software metrics:a practical guide. Prentice-Hall, Inc.
  15. Malhotra, R. and Bansal, A. J. (2015). Fault prediction considering threshold effects of object-oriented metrics. Expert Systems, 32(2):203-219.
  16. McCabe, T. J. (1976). A complexity measure. IEEE Transactions on Software Engineering, SE-2(4):308-320.
  17. Mihancea, P. and Marinescu, R. (2005). Towards the optimization of automatic detection of design flaws in object-oriented software systems. In Ninth European Conference on Software Maintenance and Reengineering, pages 92 - 101. IEEE.
  18. Nagappan, N., Ball, T., and Zeller, A. (2006). Mining metrics to predict component failures. In The 28th international conference on Software engineering (ICSE 7806), pages 452-461, New York, NY, USA,. ACM.
  19. Nejmeh, B. A. (1988). Npath: A measure of execution path complexity and its applications. Communications of the ACM, 31(2):188-200.
  20. Rodriguez, D., Ruiz, R., Riquelme, J., and Harrison, R. (2013). A study of subgroup discovery approach for defect prediction. Information and Software Technology, 55:18101822.
  21. Shatnawi, R. (2010). A quantitative investigation of the acceptable risk levels of object-oriented metrics in opensource systems. IEEE Transactions on Software Engineering, 36:216-225.
  22. Shatnawi, R., Li, W., Swain, J., and Newman, T. (2009). Finding software metrics threshold values using roc curves. Journal of Software Maintenance and Evolution: Research and Practice, 22(1):1-16.
  23. Sodiya, A. S. (2012). A survability model for objectoriented software systems. In Fourth International Conference on Computational Aspects of Social Networks (CASoN), pages 283 - 290. IEEE.
  24. Zhang, F., Mockus, A., Zou, Y., Khomh, F., and Hassan, A. E. (2013). How does context affect the distribution of software maintainability metrics? In The 29th IEEE International Conference on Software Maintainability (ICSM'13), pages 350-359, Eindhoven. IEEE.

Paper Citation

in Harvard Style

Ronchieri E. and Canaparo M. (2016). A Preliminary Mapping Study of Software Metrics Thresholds . In Proceedings of the 11th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2016) ISBN 978-989-758-194-6, pages 232-240. DOI: 10.5220/0005988402320240

in Bibtex Style

author={Elisabetta Ronchieri and Marco Canaparo},
title={A Preliminary Mapping Study of Software Metrics Thresholds},
booktitle={Proceedings of the 11th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2016)},

in EndNote Style

JO - Proceedings of the 11th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2016)
TI - A Preliminary Mapping Study of Software Metrics Thresholds
SN - 978-989-758-194-6
AU - Ronchieri E.
AU - Canaparo M.
PY - 2016
SP - 232
EP - 240
DO - 10.5220/0005988402320240