FORMATIVE AND SUMMATIVE ASSESSMENT OF CLASS DIAGRAMS - Development and Evaluation of a Prototype

Narasimha Bolloju, Ken W. K. Lee, Probir K. Banerjee

2011

Abstract

The computer-based assessment of student outputs in the field of software engineering is an area of interest amongst instructors and researchers. However, as previous efforts in this area have been mostly directed toward summative assessment, the formative feedback required for student learning has not received sufficient attention. This paper presents an approach for the formative and summative assessment of class diagrams used in systems development and reports the development, implementation and evaluation of a prototype assessment tool. The results from this empirical study demonstrate that the tool successfully provides formative feedback during the preparation of class diagrams, which helps to enhance student learning, and summative feedback that can be used as a proxy for manual summative assessment.

References

  1. Ali, N. H., Shukur, Z., & Idris, S., 2007. A design of an assessment system for UML class diagram (pp. 539- 546). Presented at the Fifth International Conference on Computational Sceince and Applications, Kuala Lumpur, Malaysia: IEEE Computer Society.
  2. Ali, N. H., Shukur, Z., & Idris, S., 2007. A design of an assessment system for UML class diagram (pp. 539- 546). Presented at the Fifth International Conference on Computational Sceince and Applications, Kuala Lumpur, Malaysia: IEEE Computer Society.
  3. Antony, S. R., & Batra, D., 2002. CODASYS: a consulting tool for novice database designers. SIGMIS Database, 33(3), 54-68.
  4. Antony, S. R., & Batra, D., 2002. CODASYS: a consulting tool for novice database designers. SIGMIS Database, 33(3), 54-68.
  5. Batra, D., 2005. Conceptual Data Modeling Patterns: Representation and Validation. Journal of Database Management, 16(2), 84-106.
  6. Batra, D., 2005. Conceptual Data Modeling Patterns: Representation and Validation. Journal of Database Management, 16(2), 84-106.
  7. Bolloju, N., 2004. Improving the quality of business object models using collaboration patterns. Communications of the ACM, 47(7), 81-86.
  8. Bolloju, N., 2004. Improving the quality of business object models using collaboration patterns. Communications of the ACM, 47(7), 81-86.
  9. Charman, D., & Elmes, A., 1998. Computer Based Assessment (Volume 2): Case studies in Science and Computing. Plymouth, UK: SEED Publications.
  10. Charman, D., & Elmes, A., 1998. Computer Based Assessment (Volume 2): Case studies in Science and Computing. Plymouth, UK: SEED Publications.
  11. Foxley, E., Higgins, C., Hegazy, T., Symeonidis, P., & Tsintsifas, A., 2001a. The CourseMaster CBA System: improvements over Ceilidh. In Proc. of Intl. Computer Assisted Assessment Conference.
  12. Foxley, E., Higgins, C., Hegazy, T., Symeonidis, P., & Tsintsifas, A., 2001a. The CourseMaster CBA System: improvements over Ceilidh. In Proc. of Intl. Computer Assisted Assessment Conference.
  13. Foxley, E., Higgins, C., Symeonidis, P., & Tsintsifas, A., 2001b. The CourseMaster automated assessment system - a next generation Ceilidh. In Computer Assisted Assessment Workshop. Warwick, UK.
  14. Foxley, E., Higgins, C., Symeonidis, P., & Tsintsifas, A., 2001b. The CourseMaster automated assessment system - a next generation Ceilidh. In Computer Assisted Assessment Workshop. Warwick, UK.
  15. Hakala, M., Hautamaki, J., Koskimies, K., Paakki, J., Viljamaa, A., & Viljamaa, J., 2001. Annotating Reusable Software Architectures with Specialization Patterns. In Proceedings of the Working IEEE/IFIP Conference on Software Architecture (p. 171). Washington, DC, USA: IEEE Computer Society.
  16. Hakala, M., Hautamaki, J., Koskimies, K., Paakki, J., Viljamaa, A., & Viljamaa, J., 2001. Annotating Reusable Software Architectures with Specialization Patterns. In Proceedings of the Working IEEE/IFIP Conference on Software Architecture (p. 171). Washington, DC, USA: IEEE Computer Society.
  17. Kaindl, H., 2004. Active tool support for requirements engineering through RETH. In 12th IEEE International Requirements Engineering Conference (RE'04) (pp. 362-363). Kyoto, Japan: IEEE Computer Society.
  18. Kaindl, H., 2004. Active tool support for requirements engineering through RETH. In 12th IEEE International Requirements Engineering Conference (RE'04) (pp. 362-363). Kyoto, Japan: IEEE Computer Society.
  19. Morisio, M., Travassos, G. H., & Stark, M. E., 2000. Extending UML to Support Domain Analysis. In Proceedings of the 15th IEEE international conference on Automated software engineering (p. 321). Grenoble, France: IEEE Computer Society.
  20. Morisio, M., Travassos, G. H., & Stark, M. E., 2000. Extending UML to Support Domain Analysis. In Proceedings of the 15th IEEE international conference on Automated software engineering (p. 321). Grenoble, France: IEEE Computer Society.
  21. Overmyer, S. P., Lavoie, B., & Rambow, O., 2001. Conceptual modeling through linguistic analysis using LIDA. In Proceedings of the 23rd International Conference on Software Engineering (pp. 401-410). Toronto, Ontario, Canada: IEEE Computer Society.
  22. Overmyer, S. P., Lavoie, B., & Rambow, O., 2001. Conceptual modeling through linguistic analysis using LIDA. In Proceedings of the 23rd International Conference on Software Engineering (pp. 401-410). Toronto, Ontario, Canada: IEEE Computer Society.
  23. Purao, S., 1998. APSARA: a tool to automate system design via intelligent pattern retrieval and synthesis. SIGMIS Database, 29(4), 45-57.
  24. Purao, S., 1998. APSARA: a tool to automate system design via intelligent pattern retrieval and synthesis. SIGMIS Database, 29(4), 45-57.
  25. Purao, S., Storey, V. C., & Han, T., 2003. Improving Analysis Pattern Reuse in Conceptual Design: Augmenting Automated Processes with Supervised Learning. Information Systems Research, 14(3), 269- 290.
  26. Purao, S., Storey, V. C., & Han, T., 2003. Improving Analysis Pattern Reuse in Conceptual Design: Augmenting Automated Processes with Supervised Learning. Information Systems Research, 14(3), 269- 290.
  27. Rawles, S., Joy, M., & Evans, M., 2002. ComputerAssisted Assessment in Computer Science: Issues and Software. University of Warwick. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10. 1.1.19.1209.
  28. Rawles, S., Joy, M., & Evans, M., 2002. ComputerAssisted Assessment in Computer Science: Issues and Software. University of Warwick. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10. 1.1.19.1209.
  29. Robbins, J. E., & Redmiles, D. F., 1998. Software architecture critics in the Argo design environment. Knowledge-Based Systems, 11(1), 47-60.
  30. Robbins, J. E., & Redmiles, D. F., 1998. Software architecture critics in the Argo design environment. Knowledge-Based Systems, 11(1), 47-60.
  31. Robbins, J. E., & Redmiles, D. F., 2000. Cognitive Support, UML Adherence, and XMI Interchange in Argo/UML. Information and Software Technology, 42(2), 79-89.
  32. Robbins, J. E., & Redmiles, D. F., 2000. Cognitive Support, UML Adherence, and XMI Interchange in Argo/UML. Information and Software Technology, 42(2), 79-89.
  33. Smaill, C., 2005. The implementation and evaluation of OASIS: a web-based learning and assessment tool for large classes. Education, IEEE Transactions on, 48(4), 658-663.
  34. Smaill, C., 2005. The implementation and evaluation of OASIS: a web-based learning and assessment tool for large classes. Education, IEEE Transactions on, 48(4), 658-663.
  35. Smith, N., Thomas, P., & Waugh, K., 2004) Interpreting imprecise diagrams. Diagrammatic Representation and Inference, 239-241.
  36. Smith, N., Thomas, P., & Waugh, K., 2004) Interpreting imprecise diagrams. Diagrammatic Representation and Inference, 239-241.
  37. Sugumaran, V., & Storey, V. C., 2002. Ontologies for conceptual modeling: their creation, use, and management. Data & Knowledge Engineering, 42(3), 251-271.
  38. Sugumaran, V., & Storey, V. C., 2002. Ontologies for conceptual modeling: their creation, use, and management. Data & Knowledge Engineering, 42(3), 251-271.
  39. Sugumaran, V., & Storey, V. C., 2006. The role of domain ontologies in database design: An ontology management and conceptual modeling environment. ACM Transactions on Database Systems, 31(3), 1064- 1094.
  40. Sugumaran, V., & Storey, V. C., 2006. The role of domain ontologies in database design: An ontology management and conceptual modeling environment. ACM Transactions on Database Systems, 31(3), 1064- 1094.
  41. Symeonidis, P., 2006. Automated assessment of java programming coursework for computer science education (Ph.D. Thesis). University of Nottingham.
  42. Symeonidis, P., 2006. Automated assessment of java programming coursework for computer science education (Ph.D. Thesis). University of Nottingham.
  43. Thomas, P., Waugh, K., & Smith. K., 2005. Experiments in the automatic marking of ER-diagrams. In Proceedings of the 10th annual SIGCSE conference on Innovation and technology in computer science education (p. 162).
  44. Thomas, P., Waugh, K., & Smith. K., 2005. Experiments in the automatic marking of ER-diagrams. In Proceedings of the 10th annual SIGCSE conference on Innovation and technology in computer science education (p. 162).
  45. Thomas, P., Waugh, K., & Smith, N., 2009. Generalised diagram revision tools with automatic marking. In Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education (pp. 318-322). Paris, France: ACM.
  46. Thomas, P., Waugh, K., & Smith, N., 2009. Generalised diagram revision tools with automatic marking. In Proceedings of the 14th annual ACM SIGCSE conference on Innovation and technology in computer science education (pp. 318-322). Paris, France: ACM.
  47. Tiantian, W., Xiaohong, S., Peijun, M., Yuying, W., & Kuanquan, W., 2010. Ability-training-oriented automated assessment in introductory programming course. Computers & Education, (In Press).
  48. Tiantian, W., Xiaohong, S., Peijun, M., Yuying, W., & Kuanquan, W., 2010. Ability-training-oriented automated assessment in introductory programming course. Computers & Education, (In Press).
  49. Tsintsifas, A., 2002. A framework for the computer-based assessment of diagram-based coursework (Ph.D. Thesis). University of Nottingham. Retrieved from http://www.cs.nott.ac.uk/azt/research.htm
  50. Tsintsifas, A., 2002. A framework for the computer-based assessment of diagram-based coursework (Ph.D. Thesis). University of Nottingham. Retrieved from http://www.cs.nott.ac.uk/azt/research.htm
  51. Viljamaa, A., 2001. Pattern-Based Framework Annotation and Adaptation - A Systematic Approach. Helsinki, Finland: Department of Computer Science, University of Helsinki.
  52. Viljamaa, A., 2001. Pattern-Based Framework Annotation and Adaptation - A Systematic Approach. Helsinki, Finland: Department of Computer Science, University of Helsinki.
  53. Waugh, K. G., Thomas, P. G., & Smith, N., 2004. Toward the automated assessment of entity-relationship diagrams. In Proceedings of the 2nd LTSN-ICS Teaching, Learning and Assessment in Databases Workshop. Edinburgh, UK.
  54. Waugh, K. G., Thomas, P. G., & Smith, N., 2004. Toward the automated assessment of entity-relationship diagrams. In Proceedings of the 2nd LTSN-ICS Teaching, Learning and Assessment in Databases Workshop. Edinburgh, UK.
  55. Wohed, P., 2000. Tool support for reuse of analysis patterns: a case study. In Proceedings of the 19th international conference on Conceptual modeling (pp. 196-209). Salt Lake City, Utah, USA: SpringerVerlag.
  56. Wohed, P., 2000. Tool support for reuse of analysis patterns: a case study. In Proceedings of the 19th international conference on Conceptual modeling (pp. 196-209). Salt Lake City, Utah, USA: SpringerVerlag.
Download


Paper Citation


in Harvard Style

Bolloju N., W. K. Lee K. and K. Banerjee P. (2011). FORMATIVE AND SUMMATIVE ASSESSMENT OF CLASS DIAGRAMS - Development and Evaluation of a Prototype . In Proceedings of the 3rd International Conference on Computer Supported Education - Volume 2: ATTeL, (CSEDU 2011) ISBN 978-989-8425-50-8, pages 402-410. DOI: 10.5220/0003476504020410


in Harvard Style

Bolloju N., W. K. Lee K. and K. Banerjee P. (2011). FORMATIVE AND SUMMATIVE ASSESSMENT OF CLASS DIAGRAMS - Development and Evaluation of a Prototype . In Proceedings of the 3rd International Conference on Computer Supported Education - Volume 2: ATTeL, (CSEDU 2011) ISBN 978-989-8425-50-8, pages 402-410. DOI: 10.5220/0003476504020410


in Bibtex Style

@conference{attel11,
author={Narasimha Bolloju and Ken W. K. Lee and Probir K. Banerjee},
title={FORMATIVE AND SUMMATIVE ASSESSMENT OF CLASS DIAGRAMS - Development and Evaluation of a Prototype},
booktitle={Proceedings of the 3rd International Conference on Computer Supported Education - Volume 2: ATTeL, (CSEDU 2011)},
year={2011},
pages={402-410},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003476504020410},
isbn={978-989-8425-50-8},
}


in Bibtex Style

@conference{attel11,
author={Narasimha Bolloju and Ken W. K. Lee and Probir K. Banerjee},
title={FORMATIVE AND SUMMATIVE ASSESSMENT OF CLASS DIAGRAMS - Development and Evaluation of a Prototype},
booktitle={Proceedings of the 3rd International Conference on Computer Supported Education - Volume 2: ATTeL, (CSEDU 2011)},
year={2011},
pages={402-410},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003476504020410},
isbn={978-989-8425-50-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Computer Supported Education - Volume 2: ATTeL, (CSEDU 2011)
TI - FORMATIVE AND SUMMATIVE ASSESSMENT OF CLASS DIAGRAMS - Development and Evaluation of a Prototype
SN - 978-989-8425-50-8
AU - Bolloju N.
AU - W. K. Lee K.
AU - K. Banerjee P.
PY - 2011
SP - 402
EP - 410
DO - 10.5220/0003476504020410


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Computer Supported Education - Volume 2: ATTeL, (CSEDU 2011)
TI - FORMATIVE AND SUMMATIVE ASSESSMENT OF CLASS DIAGRAMS - Development and Evaluation of a Prototype
SN - 978-989-8425-50-8
AU - Bolloju N.
AU - W. K. Lee K.
AU - K. Banerjee P.
PY - 2011
SP - 402
EP - 410
DO - 10.5220/0003476504020410