Classifying Web Metrics

Julián Ruiz, Coral Calero, Mario Piattini

2004

Abstract

Quality is an essential characteristic for web success. Several authors have defined different methodologies, guidelines, techniques and tools in order to assure the quality of web sites. Recently, a wide ranging set of metrics have been proposed for quantifying web quality attributes. However, there is little consensus among them. These metrics are sometimes not well defined, neither empirically or theoretically validated. Moreover, these metrics focus on different aspects of web sites or different quality characteristics, confusing the practitioners interested in using these metrics rather than helping them. With the aim of classifying these metrics and make their use easier, we have elaborated the WQM model (Web Quality Model), which distinguishes three dimensions related to features, lifecycle processes and quality characteristics. In this paper we analyze the most relevant web metrics using this framework and present some preliminary conclusions.

References

  1. Abrahão S., Olsina L., Pastor O. (2002) A Methodology for Evaluating Quality and Functional Size of Operative WebApps, In Proc. of 2nd International Workshop on Web Oriented Software Technology, ECOOP'02 Workshops, Málaga, Spain, pp. 1-20.
  2. Abrahão, S., Condori-Fernandez, N., Olsina, L., Pastor, O. (2003) Defining and Validating Metrics for Navigational Models. Ninth International Software Metrics Symposium (METRICS'03), September 03 - 05.
  3. Abrahão, S., Pastor, O. (2003) Calidad de Sistemas Web. En: Calidad en el Desarrollo y mantenimiento del software. Madrid, Ed. Ra-Ma (spanish).
  4. Alves de Silva, E.A., Ponti de Mattos Fortes, R. Web Quality Metrics: An Analysis Using Machine Learning Systems. International Conference on Information Systems, Analysis and Sintesis. World Multiconference on Systemics, Cybernetics and Informatics. Information Systems Technology. SCI 2001/ ISAS 2001. Volumen XI.
  5. Avison, D. E., Fitzgerald, G. (2003). Where Now for Development Methodologies? Communications of the ACM, 46 (1), 79-82.
  6. Bajaj, A., Krishnan, R. CMU-WEB: A Conceptual Model for Designing Usable Web Applications. J. Database Manag. 10(4): 33-43 (1999)
  7. Baresi, L., Morasca, S., Paolini, P. Estimating the Design Effort of Web Applications. Proc. 9th International Metrics Symposium (METRICS'03) IEEE, 2003.
  8. Botafogo, R., Rivlin, E., Shneiderman, B. Structural analysis of hypertexts: Identifying hierarchies and useful metrics. ACM Trans. Inform. Systems, 10(2):142--180, Apr. 1992.
  9. Calero,C., Piattini, M., and Genero, M. (2001). Empirical Validation of Referential Integrity Metrics. Information Software and Technology. Special Issue on Controlled Experiments in Software Technology. Vol. 43, Nº 15. 2001.
  10. Cleary (2000), Web-Based Development and Functional Size Measurement. Proc. IFPUG Annual Conference, San Diego-CA, September.
  11. Cutter Consortium, (2000) Poor Project Management - Problem of E-Projects. October 2000, http://www.cutter.com/press/001019.html
  12. Dhyani, D., NG, W.K. and Bhowmick, S.S. (2002). A Survey of Web Metrics. ACM Computing Surveys, 34 (4), 469-503.
  13. Donaldson, A.J.M., Cowderoy, A.J.C. (1997). Towards Multimedia Systems Quality. ESSISCOPE conference, Dublin.
  14. Fink D. (2001) Web Site Effectiveness: A Measure of Information and Service Quality, Information Resource Management Association International Conference, Toronto, Canada.
  15. Fraternali, P. Tools and Approaches for Developing Data -Intensive Web Applications: A survey. ACM Computing Surveys, Vol 31, No. 3, Sept 1999
  16. Gómez, J., Cachero, C., Pastor, O. (2001). Conceptual Modeling of Device-Independent web applications. IEEE Multimedia. April-June 2001. pp. 26-39
  17. Herder, E. Metrics for the Adaptation of Site Structure. Proc. of the German Workshop on Adaptivity and User Modeling in Interactive Systems ABIS02 - Hannover, 2002 pp. 22-26
  18. Herzinger M. Hyperlink Analysis for the web. IEEE Internet Computing, Jan-Feb 2001.
  19. ISO/IEC (1995) ISO/IEC 12207. Information Technology. Software Life Cycle Processes.
  20. ISO/IEC (2001) ISO/IEC 9126. Software Product Evaluation-Quality Characteristics and Guidelines for their Use.
  21. ISO/IEC (2001) ISO/IEC 15288. Systems Engineering - System Life Cycle Processes.
  22. Ivory, M., Hearst, M. The State of the Art in Automating Usability Evaluation of User Interfaces. ACM Comput. Surv. Vol. 33, No. 4: 470-516 (Dec. 2001)
  23. Ivory, M.Y., Sinha, R.R., Hearst, M.A.: Empirically Validated Web Page Design Metrics, SIGCHI 2001.
  24. Ivory, M.Y.. An Empirical Foundation for Automated Web Interface Evaluation. PhD Thesis, University of California, Berkeley, Computer Science Division, 2001.
  25. Katterattanakul, P. and Siau, K. (2001). Information Quality in Internet Commerce Desig n. “Information and database quality”. Kluwer Academic.
  26. Lafuente, G., González, J., Olsina, L. (2001) Automatizando Métricas Web, 4º Encontro para a Qualidade nas Tecnologias de Informação e Comunicações (QUATIC), Lisboa, Portugal, pp.17-24.
  27. Mendes, E., Counsell, S. Web Development Effort Estimation using Analogy. Proceedings of the 2000 Australian Software Engineering Conference - ASWEC 2000, April 28-April 30, Australian National University, Canberra, ACT, Australia, IEEE CS Press. pp. 203-212.
  28. Mendes, E., Mosley, N., Counsell, S. (2001) Web metrics - Metrics for estimating effort to design and author Web applications. IEEE MultiMedia, special issue on Web Engineering, January-March, pp. 50-57.
  29. Mendes, E, Mosley, N., Counsell, S. Comparison of Web size measures for predicting Web design and authoring effort. IEE Proceedings - Software 149(3): 86-92 (2002)
  30. Mendes, E., Watson, I., Trigss, C., Mosley, N., Counsell, S. A Comparison of Development Effort Estimation Techniques for Web Hypermedia Applications. Proceedings IEEE Metrics June, 2002, Ottawa, Canada. Pp. 131-140.
  31. Mendes, E., Mosley, N., Counsell, S. Early Web Size Measures and Effort Prediction for Web Costimation. Proc. 9th International Metrics Symposium (METRICS'03) IEEE METRICS 2003: 18-29.
  32. Morisio, M., Stamelos, I., Spahos, V. Romano, D. Measuring Functionality and Productivity in Web-Based Applications: A Case Study. Sixth IEEE International Symposium on Software Metrics, November, 1999.
  33. Niessink, F. (2002) Software Requirements: Functional & Non-functional Software Requirements. www.cs.uu.nl/docs/vakken/swa/ Slides/SA-2-Requirements.pdf
  34. Olsina, L., Quantitative Methodology for Evaluation and Comparison of Web Site Quality, PhD Thesis, Ciencias Exactas School, UNLP, La Plata, Argentina, 2000.
  35. Olsina , L., Lafuente, G., Rossi, G. (2001) Specifying Quality Characteristics and Attributes for Websites. Web Engineering: Managing Diversity and Complexity of Web Application Development. Springer-Verlag, June, pp. 266-277.
  36. Olsina, L., Rossi, G. (2001) A Quantitative Method for Quality Evaluation of WebApps. ASSE2001
  37. Olsina L., Rossi G., Measuring Web Application Quality with WebQEM, IEEE Multimedia, October-December 2002, pp. 20-29.
  38. Olsina, L., Martín M., Fons, J., Abrahão, S., Pastor, O. Towards the Design of a Metrics Cataloging System by Exploiting Conceptual and Semantic Web Approaches. Proc. of the International Conference on Web Engineering (ICWE 2003), LNCS 2722, pp. 324-333.
  39. Palmer, J. Web Site Usability, Design and Performance Metrics, Information Systems Research, June 2002, 13(2), 151-167.
  40. Pressman, R.S. (2000) What a Tangled Web We Weaved. IEEE Software, Vol. 17, No. 1. Jan-Feb, pp. 18-21.
  41. Ramler, R., Weippl, E., Winterer, M., Shwinger, W., Altmann, J. (2002). A Quality-Driven Approach to Web Testing. Iberoamerican Conference on Web Engineering, ICWE'02. Argentina. September. Vol. 1. pp. 81-95.
  42. Reifer, D. Web Development: Estimating Quick -to-Market Software. IEEE Software, NovDec 2000. pp. 57-64. BUENO
  43. Reifer, D. Ten Deadly Risks in Internet and Intranet Software Development. IEEE Software, March-April, 2002. pp. 12-14. VALE
  44. Rivlin, E., Botafago, R., Shneiderman, B. Navigating in hyperspace: Designing a structurebased toolbox, Communications of the ACM, Vol. 37, No. 2, February 1994, pp. 87-96.
  45. Ruhe, M., Jeffery, R., Wieczorek, I. Using Web Objects for Estimating Software Development Effort for Web Applications. Proc. 9th International Metrics Symposium (METRICS'03) IEEE, 2003.
  46. Ruiz, J., Calero, C. and Piattini, M. (2003). A Three Dimensional Web Quality Model. Proc. of the International Conference on Web Engineering (ICWE'03), LNCS 2722, pp. 384-385.
  47. W3C (1999) WWW Consortium: Web Content Accessibility Guidelines 1.0, W3C Working Draft. http://www.w3.org/TR/WCAG10/
  48. Warren, P., Gaskell, C., Boldyreff, C., Preparing the Ground for Website Metrics Research. Proc. 3rd International Workshop on Web Site Evolution (WSE'01). IEEE 2001.
Download


Paper Citation


in Harvard Style

Ruiz J., Calero C. and Piattini M. (2004). Classifying Web Metrics . In Proceedings of the 1st International Workshop on Software Audits and Metrics - Volume 1: SAM, (ICEIS 2004) ISBN 972-8865-04-X, pages 22-37. DOI: 10.5220/0002686800220037


in Bibtex Style

@conference{sam04,
author={Julián Ruiz and Coral Calero and Mario Piattini},
title={Classifying Web Metrics},
booktitle={Proceedings of the 1st International Workshop on Software Audits and Metrics - Volume 1: SAM, (ICEIS 2004)},
year={2004},
pages={22-37},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002686800220037},
isbn={972-8865-04-X},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Workshop on Software Audits and Metrics - Volume 1: SAM, (ICEIS 2004)
TI - Classifying Web Metrics
SN - 972-8865-04-X
AU - Ruiz J.
AU - Calero C.
AU - Piattini M.
PY - 2004
SP - 22
EP - 37
DO - 10.5220/0002686800220037