Circumstantial-evidence-based Judgment for Software Effort Estimation

Zheng Li, Liam O'Brien, He Zhang


Expert judgment for software effort estimation is oriented toward direct evidences that refer to actual effort of similar projects or activities through experts’ experiences. However, the availability of direct evidences implies the requirement of suitable experts together with past data. The circumstantial-evidence-based judgment proposed in this paper focuses on the development experiences deposited in human knowledge, and can then be used to qualitatively estimate implementation effort of different proposals of a new project by rational inference. To demonstrate the process of circumstantial-evidence-based judgment, this paper adopts propositional learning theory based diagnostic reasoning to infer and compare different effort estimates when implementing a Web service composition project with some different techniques and contexts. The exemplar shows our proposed work can help determine effort tradeoff before project implementation. Overall, circumstantial-evidence-based judgment is not an alternative but complementary to expert judgment so as to facilitate and improve software effort estimation.


  1. Jørgensen, M., Shepperd, M.: A Systematic Review of Software Development Cost Estimation Studies. IEEE Trans. Software Eng. 33, 1 (2007) 33-53.
  2. Menzies, T., Hihn, J.: Evidence-Based Cost Estimation for Better-Quality Software. IEEE Softw. 23, 4 (2006) 64-66.
  3. Keung, J.: An Alternative Approach to Software Cost Estimation: Reasoning by Analogy. In: Presentations of Australian Conference on Software Measurement (ACOSM 2007), Sydney, Australia (2007).
  4. Jørgensen, M.: Practical Guidelines for Expert-Judgment-Based Software Effort Estimation. IEEE Softw. 22, 3 (2005) 57-63.
  5. Dybå, T., Kitchenham, B. A., Jørgensen, M.: Evidence-Based Software Engineering for Practitioners. IEEE Softw. 22, 1 (2005) 58-65.
  6. Siegel, J. A., Knupfer, G. C., Saukko, P. J., Saukko, P. J.: Encyclopedia of Forensic Sciences. Academic Press, San Diego, CA (2000).
  7. Heller, K. J.: The Cognitive Psychology of Circumstantial Evidence. Mich. L. Rev. 105, 2 (2006) 241-306.
  8. Globerson, T.: Mental Capacity, Mental Effort, and Cognitive Style. Dev. Rev. 3, 3 (1983) 292-302.
  9. Cardoso, J.: How to Measure the Control-Flow Complexity of Web Processes and Workflows. In: Workflow Handbook 2005. Layna Fischer, Lighthouse Point, Florida (2005) 199-212.
  10. Miller, G. A.: The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychol. Rev. 63, 2 (1956) 81-97.
  11. Francalanci, C., Merlo, F.: The Impact of Complexity on Software Design Quality and Costs: An Exploratory Empirical Analysis of Open Source Applications. In: Proceedings of the 16th European Conference on Information Systems (ECIS 2008), Galway, Ireland (2008) 1442-1453.
  12. Turner, J. R., Cochrane, R. A.: Goals-and-Methods Matrix: Coping with Projects with Illdefined Goals and/or Methods of Achieving them. Int. J. Project Manage. 11, 2 (1993), 93- 102.
  13. Dooley, K.: Organizational Complexity. In: International Encyclopedia of Business and Management, M. Warner, Ed. Thompson Learning, London (2001) 5013-5022.
  14. Josuttis, N. M.: SOA in Practice: The Art of Distributed System Design. O'Reilly Media, Inc., Sebastopol, CA (2007).
  15. Carlson, R. A., Dulany D. E.: Diagnostic Reasoning with Circumstantial Evidence. Cognitive. Psychol. 20, 4 (1988) 463-492.
  16. Li, Z., O'Brien, L., Keung, J., and Xu, X.: Effort-Oriented Classification Matrix of Web Service Composition. In: Proceedings of the Fifth International Conference on Internet and Web Applications and Services (ICIW 2010), Barcelona, Spain (2010) 357-362.
  17. Barros, A., Dumas, M., Oaks, P.: Standards for Web Service Choreography and Orchestration: Status and Perspectives. Lect. Notes. Comput. Sc. 3812/2006 (2006) 61-74.
  18. Hepp, M.: Semantic Web and Semantic Web Services: Father and Son or Indivisible Twins? IEEE. Internet. Comput. 10, 2 (2006) 85-88.
  19. Raymond, E. S.: The Art of UNIX Programming. Addison-Wesley Professional, Boston, MA (2004).
  20. Boehm, B.: Software Engineering Economics. Prentice Hall, Upper Saddle River, NJ (1981).

Paper Citation

in Harvard Style

Li Z., O'Brien L. and Zhang H. (2011). Circumstantial-evidence-based Judgment for Software Effort Estimation . In Proceeding of the 1st International Workshop on Evidential Assessment of Software Technologies - Volume 1: EAST, (ENASE 2011) ISBN 978-989-8425-58-4, pages 18-27

in Bibtex Style

author={Zheng Li and Liam O'Brien and He Zhang},
title={Circumstantial-evidence-based Judgment for Software Effort Estimation},
booktitle={Proceeding of the 1st International Workshop on Evidential Assessment of Software Technologies - Volume 1: EAST, (ENASE 2011)},

in EndNote Style

JO - Proceeding of the 1st International Workshop on Evidential Assessment of Software Technologies - Volume 1: EAST, (ENASE 2011)
TI - Circumstantial-evidence-based Judgment for Software Effort Estimation
SN - 978-989-8425-58-4
AU - Li Z.
AU - O'Brien L.
AU - Zhang H.
PY - 2011
SP - 18
EP - 27
DO -