Empowering Testing Activities with Modeling - Achievements and Insights from Nine Years of Collaboration with Cisco

Shaukat Ali, Marius Liaaen, Shuai Wang, Tao Yue

Abstract

Research-Based Innovation (RBI) aims at bringing research-driven innovative solutions to the industrial problems identified from the industry in close collaboration with researchers. This paper focuses on presenting one such instance of RBI between Cisco Systems, Norway and the Software Engineering department of Simula Research Laboratory, Norway over the period of last nine years. The main topic of the collaboration was related to improving the current testing practice at Cisco with the use of models. We present a brief overview of various model-driven testing projects, and lessons learned from such RBI collaboration from researchers’ perspective.

References

  1. Ali, S., Briand, L., Arcuri, A. & Walawege, S. 2011a. An Industrial Application Of Robustness Testing Using Aspect-Oriented Modeling, UML/MARTE, And Search Algorithms. ACM/IEEE 14th International Conference On Model Driven Engineering Languages And Systems (Models 2011).
  2. Ali, S., Briand, L. C. & Hemmati, H. 2012a. Modeling Robustness Behavior Using Aspect-Oriented Modeling To Support Robustness Testing Of Industrial Systems. Software And Systems Modeling, 11, 633-670.
  3. Ali, S., Briand, L. C., Hemmati, H. & Panesar-Walawege, R. K. 2009. A Systematic Review of the Application And Empirical Investigation of Search-Based Test Case Generation. Ieee Transactions On Software Engineering, 99.
  4. Ali, S. & Hemmati, H. Model-Based Testing of Video Conferencing Systems: Challenges, Lessons Learnt, And Results. 2014 IEEE Seventh International Conference On Software Testing, Verification And Validation, March 31 2014-April 4 2014 2014. 353-362.
  5. Ali, S., Hemmati, H., Holt, N. E., Arisholm, E. & Briand, L. 2010. Model Transformations As A Strategy To Automate Model-Based Testing - A Tool And Industrial Case Studies, Simula Research Laboratory, Technical Report (2010-01).
  6. Ali, S., Iqbal, M. Z. & Arcuri, A. 2014. Improved Heuristics For Solving OCL Constraints Using Search Algorithms. Proceedings of The 2014 Conference On Genetic and Evolutionary Computation. Vancouver, Bc, Canada: ACM.
  7. Ali, S., Iqbal, M. Z., Arcuri, A. & Briand, L. 2011b. A Search-Based OCL Constraint Solver for ModelBased Test Data Generation. Proceedings of The 11th International Conference on Quality Software (Qsic 2011). IEEE Computer Society.
  8. Ali, S., Iqbal, M. Z., Arcuri, A. & Briand, L. 2012b. Generating Test Data from OCL Constraints With Search Techniques. Simula Research Laboratory.
  9. Ali, S., Yue, T., Briand, L. & Walawege, S. 2012c. A Product Line Modeling and Configuration Methodology to Support Model-Based Testing: An Industrial Case Study. In: France, R., Kazmeier, J., Breu, R. & Atkinson, C. (Eds.) Model Driven Engineering Languages and Systems. Springer Berlin Heidelberg.
  10. Briand, L., Falessi, D., Nejati, S., Sabetzadeh, M. & Yue, T. 2012. Research-Based Innovation: A Tale of Three Projects In Model-Driven Engineering. In: France, R. B., Kazmeier, J., Breu, R. & Atkinson, C. (Eds.) Model Driven Engineering Languages And Systems: 15th International Conference, MODELS 2012, Innsbruck, Austria, September 30-October 5, 2012. Proceedings. Berlin, Heidelberg: Springer Berlin Heidelberg.
  11. Hemmati, H., Arcuri, A. & Briand, L. 2013. Achieving Scalable Model-Based Testing Through Test Case Diversity. ACM Trans. Softw. Eng. Methodol., 22, 1-42.
  12. Pradhan, D., Wang, S., Ali, S., Yue, T. & Liaaen, M. 2016. Stipi: Using Search To Prioritize Test Cases Based On Multi-Objectives Derived From Industrial Practice. In: Wotawa, F., Nica, M. & Kushik, N. (eds.) Testing Software And Systems: 28th IFIP WG 6.1 International Conference, ICTSS 2016, Graz, Austria, October 17-19, 2016, Proceedings. Cham: Springer International Publishing.
  13. Sjøberg, D. I. K. 2010. The Industry is our Lab - Organisation and Conduct Of Empirical Studies In Software Engineering at Simula. In: Tveito, A., Bruaset, A. M. & Lysne, O. (eds.) Simula Research Laboratory: By Thinking Constantly About it. Berlin, Heidelberg: Springer Berlin Heidelberg.
  14. Wang, S., Ali, S. & Gotlieb, A. Minimizing Test Suites In Software Product Lines Using Weight-Based Genetic Algorithms. Proceeding of The Fifteenth Annual Conference on Genetic and Evolutionary Computation Conference, 2013a. ACM, 1493-1500.
  15. Wang, S., Ali, S. & Gotlieb, A. 2014a. Cost-Effective Test Suite Minimization In Product Lines Using Search Techniques. Journal of Systems And Software.
  16. Wang, S., Ali, S., Gotlieb, A. & Liaaen, M. 2015. Automated Product Line Test Case Selection: Industrial Case Study and Controlled Experiment. Software & Systems Modeling, 1-25.
  17. Wang, S., Ali, S., Gotlieb, A. & Liaaen, M. 2016a. A Systematic Test Case Selection Methodology for Product Lines: Results And Insights from An Industrial Case Study. Empirical Software Engineering, 21, 1586-1622.
  18. Wang, S., Ali, S., Yue, T., Bakkeli, Y. & Liaaen, M. 2016b. Enhancing Test Case Prioritization In An Industrial Setting With Resource Awareness And Multi-Objective Search. Proceedings of The 38th International Conference on Software Engineering Companion. Austin, Texas: ACM.
  19. Wang, S., Ali, S., Yue, T., Li, Y. & Liaaen, M. 2016c. A Practical Guide To Select Quality Indicators For Assessing Pareto-Based Search Algorithms In SearchBased Software Engineering. Proceedings Of The 38th International Conference on Software Engineering. Austin, Texas: ACM.
  20. Wang, S., Ali, S., Yue, T. & Liaaen, M. Using Feature Model To Support Model-Based Testing of Product Lines: An Industrial Case Study. 2013 13th International Conference on Quality Software, 29-30 July 2013 2013b. 75-84.
  21. Wang, S., Buchmann, D., Ali, S., Gotlieb, A., Pradhan, D. & Liaaen, M. Multi-Objective Test Prioritization In Software Product Line Testing: An Industrial Case Study. Proceedings of The 18th International Software Product Line Conference-Volume 1,2014b.ACM, 32-41
  22. Wang, S., Gotlieb, A., Ali, S. & Liaaen, M. 2013a. Automated Test Case Selection Using Feature Model: An Industrial Case Study. In: Moreira, A., Schätz, B., Gray, J., Vallecillo, A. & Clarke, P. (Eds.) ModelDriven Engineering Languages And Systems. Springer Berlin Heidelberg.
  23. Yue, T., Ali, S. & Zhang, M. 2015. Rtcm: A Natural Language Based, Automated, And Practical Test Case Generation Framework. Proceedings Of The 2015 International Symposium on Software Testing And Analysis. Baltimore, Md, Usa: ACM.
Download


Paper Citation


in Harvard Style

Ali S., Liaaen M., Wang S. and Yue T. (2017). Empowering Testing Activities with Modeling - Achievements and Insights from Nine Years of Collaboration with Cisco . In Proceedings of the 5th International Conference on Model-Driven Engineering and Software Development - Volume 1: IndTrackMODELSWARD, (MODELSWARD 2017) ISBN 978-989-758-210-3, pages 581-589. DOI: 10.5220/0006216105810589


in Bibtex Style

@conference{indtrackmodelsward17,
author={Shaukat Ali and Marius Liaaen and Shuai Wang and Tao Yue},
title={Empowering Testing Activities with Modeling - Achievements and Insights from Nine Years of Collaboration with Cisco},
booktitle={Proceedings of the 5th International Conference on Model-Driven Engineering and Software Development - Volume 1: IndTrackMODELSWARD, (MODELSWARD 2017)},
year={2017},
pages={581-589},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006216105810589},
isbn={978-989-758-210-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Model-Driven Engineering and Software Development - Volume 1: IndTrackMODELSWARD, (MODELSWARD 2017)
TI - Empowering Testing Activities with Modeling - Achievements and Insights from Nine Years of Collaboration with Cisco
SN - 978-989-758-210-3
AU - Ali S.
AU - Liaaen M.
AU - Wang S.
AU - Yue T.
PY - 2017
SP - 581
EP - 589
DO - 10.5220/0006216105810589