Interaction Modeling in PRACTICE - CTT Vs. SCXML - A Comparison of Two Practical Solutions Applying Interaction Modeling Techniques for Multimodal User-System Interaction

Miroslav Sili, Matthias Gira, Markus Müllner-Rieder, Christopher Mayer

2015

Abstract

Nowadays, we are surrounded by various devices to interact with digital media and services. Each device and its in- and output modalities can support users’ abilities differently. Thus, it is important to cover a wide range of interaction devices. Modeling user interaction instead of modeling single user interfaces customized to the device is a starting point to do so. This work targets the comparison of two different user interaction modeling techniques used for the design of multimodal user interfaces. Next to the general concepts of the two interaction modeling techniques, the corresponding execution frameworks and the practical exploration results are presented. This paper summarizes advantages and disadvantages of each approach and the comparison clarifies that the CTT approach applied in AALuis is more applicable for large and complex user interaction scenarios. The SCXML approach applied in the ibi project is more suitable for lightweight and structurally simpler user interaction scenarios.

References

  1. Janssen, C., Weisbecker, A., Ziegler, J., 1993. Generating user interfaces from data models and dialogue net specifications. Proceedings of the INTERACT'93 and CHI'93 conference on human factors in computing systems, pp. 418-423.
  2. Puerta, A., Eisenstein, J., 1999. Towards a general computational framework for model-based interface development systems. Knowledge-Based Systems 12.8, pp. 433-442.
  3. Paternò, F., Mancini, C., Meniconi, S., 1997. ConcurTaskTrees: A diagrammatic notation for specifying task models. Human-Computer Interaction INTERACT'97, pp. 362-369.
  4. Barnett, J., Akolkar, R., Auburn, R. J., Bodell, M., Burnett, D. C., Carter, J., Rosenthal, N. A. (2007). State chart XML (SCXML): State machine notation for control abstraction. W3C working draft.
  5. Aaluis.eu, 2015. AALuis - Ambient Assisted Living user interfaces. Available from <http://www.aaluis.eu>. [16 March 2015].
  6. Ibi.or.at, 2015. Das Projekt. Available from <http://www.ibi.or.at>. [16 March 2015].
  7. Mori, G., Paterno, F., Santoro, C., 2004. Design and development of multidevice user interfaces through multiple logical descriptions. Software Engineering, IEEE Transactions. pp. 507-520.
  8. Peissner, M., Häbe, D., Janssen, D., Sellner, T., 2012. MyUI: generating accessible user interfaces from multimodal design patterns. Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems. pp. 81-90.
  9. Popp, R., Raneburger, D., Hermann K., 2013. Tool support for automated multidevice GUI generation from discoursebased communication models. Proceedings of the 5th ACM SIGCHI Symposium on Engineering Interactive computing systems. pp. 145- 150.
  10. Brambilla, M., Mauri, A., Umuhoza, E., 2014. IFML: Building the FrontEnd of Web and Mobile Applications with OMG's Interaction Flow Modeling Language. Web Engineering, Springer LNCS vol. 8640. p. 575.
  11. Harel, D., 1987. Statecharts: A visual formalism for complex systems. Science of computer programming 8.3. pp. 231-274.
  12. Zur Muehlen, M., Recker, J., 2008. How much language is enough? Theoretical and practical use of the business process modeling notation. Advanced information systems engineering pp. 465-479.
  13. Mori, G., Paternò, F., Santoro C., 2002. CTTE: Support for Developing and Analyzing Task Models for Interactive System Design. IEEE Trans. Softw. Eng., 28(8). pp. 797-813.
  14. Romellini, C. Tonelli, F., 2005. CCXML: The Power of Standardization. Loquendo.
  15. W3.org, 2015a. Voice Browser Call Control: CCXML Version 1.0. Available from <http://www.w3.org/TR/ccxml/>. [18 March 2015].
  16. Almeida, N., Silva, S., Teixeira, A., 2014. Multimodal Multi Device Application Supported by an SCXML State Chart Machine. Engineering Interactive Computer Systems with SCXML. p. 12.
  17. Dragert, C. W., 2013. ModelDriven Development of AI for Digital Games. Doctoral dissertation, McGill University.
  18. Jeong, H., Kim, S., Do, H., Choi, E., Jeong, Y., Kang, Y. 2012. Multimodal Interface for Mobile Cloud Computing. Latest Advances in Information Science and Applications WSEAS Press. pp. 270 - 274.
  19. Code.google.com, 2015a. scxmlgui - A graphical editor for SCXML finite state machines. - Google Project Hosting. Available from <https://code.google.com/p/scxmlgui/>. [16 March 2015].
  20. Team Commons, 2015. SCXML - Commons SCXML. Commons.apache.org. Available from <http://commons.apache.org/proper/commonsscxml/>. [16 March 2015].
  21. Code.google.com, 2015b. scxmlcc - scxml to C++ compiler - Google Project Hosting. Available from <https://code.google.com/p/scxmlcc/>. [16 March 2015].
  22. GitHub, 2013. jroxendal/PySCXML. Available from <https://github.com/jroxendal/PySCXML>. [16 March 2015].
  23. Alliance, OSGi, 2003. Osgi service platform, release 3. IOS Press, Inc.
  24. Mayer, C., Zimmermann, G., Grguric, A., Alexandersson J., Sili, M., Strobbe, C., 2015. A comparative study of systems for the design of flexible user interfaces, Journal of Ambient Intelligence and Smart Environments. in press. ("accepted").
  25. W3.org, 2015b. XHTML 1.0: The Extensible HyperText Markup Language (Second Edition). [online] Available at: Available from <http://www.w3.org/ TR/xhtml1 [Accessed 18 Mar. 2015].
  26. W3.org, 2015c. XHTML 1.0: The Extensible HyperText Markup Language (Second Edition). [online] Available at: Available from <http://www.w3.org/TR/ xhtml1 [Accessed 18 Mar. 2015].
  27. Richardson, L., Ruby, S., 2008. RESTful web services O'Reilly Media, Inc.
  28. Sili, M., Bobeth, J., Sandner, E., Hanke, S., Schwarz, S., Mayer, C., 2014. Talking Faces in Lab and Field Trials - A View on Evaluation Settings and User Involvement Results of Avatar Based User Interaction Techniques in Three Ambient Assisted Living Projects. International Conference on HumanComputer Interaction. in press.
Download


Paper Citation


in Harvard Style

Sili M., Gira M., Müllner-Rieder M. and Mayer C. (2015). Interaction Modeling in PRACTICE - CTT Vs. SCXML - A Comparison of Two Practical Solutions Applying Interaction Modeling Techniques for Multimodal User-System Interaction . In Proceedings of the 1st International Conference on Information and Communication Technologies for Ageing Well and e-Health - Volume 1: ICT4AgeingWell, ISBN 978-989-758-102-1, pages 243-250. DOI: 10.5220/0005481502430250


in Bibtex Style

@conference{ict4ageingwell15,
author={Miroslav Sili and Matthias Gira and Markus Müllner-Rieder and Christopher Mayer},
title={Interaction Modeling in PRACTICE - CTT Vs. SCXML - A Comparison of Two Practical Solutions Applying Interaction Modeling Techniques for Multimodal User-System Interaction},
booktitle={Proceedings of the 1st International Conference on Information and Communication Technologies for Ageing Well and e-Health - Volume 1: ICT4AgeingWell,},
year={2015},
pages={243-250},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005481502430250},
isbn={978-989-758-102-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Information and Communication Technologies for Ageing Well and e-Health - Volume 1: ICT4AgeingWell,
TI - Interaction Modeling in PRACTICE - CTT Vs. SCXML - A Comparison of Two Practical Solutions Applying Interaction Modeling Techniques for Multimodal User-System Interaction
SN - 978-989-758-102-1
AU - Sili M.
AU - Gira M.
AU - Müllner-Rieder M.
AU - Mayer C.
PY - 2015
SP - 243
EP - 250
DO - 10.5220/0005481502430250