Tiago Reis, Marco de Sá, Luís Carriço



Users’ characteristics and their different mobility stages sometimes reduce or eliminate their capability to perform paper-based activities. The support of such activities and their extension through the utilization of non paper-based modalities introduces new perspectives on their accomplishment. We introduce mobile multimodal artefacts and an artefact framework as a solution to this problem. We briefly explain the main tools of this framework and detail two versions of the multimodal artefact manipulation tool: a visual centred and eye-free version. The design and evaluation process of the tool is presented including several usability tests.


  1. Blenkhorn P., Evans D. G., 1998. Using speech and touch to enable blind people to access schematic diagrams. Journal of Network and Computer Applications, Vol. 21, pp. 17-29.
  2. Boyd, L.H., Boyd, W.L., Vanderheiden, G.C., 1990. The Graphical User Interface: Crisis, Danger and OpportuniQ. Journal of Visual Impairment and Blindness, Vol. 84, pp. 496-502.
  3. Burger, D., Sperandio, J., 1993 (ed.) Non-Visual HumanComputer Interactions: Prospects for the visually handicapped. Paris: John Libbey Eurotext. pp. 181- 194.
  4. Gibbon, D., Mertins, I. and Moore, R., 2000. Handbook of Multimodal and Spoken Dialogue Systems. Resources,Terminology and Product Evaluation. Kluwer.
  5. Hurtig, T., 2006. A mobile multimodal dialogue system for public transportation navigation evaluated. In Procs. of HCI'06. ACM Press pp. 251-254.
  6. Lai, J., 2004. Facilitating Mobile Communication with Multimodal Access to Email Messages on a Cell Phone. In Procs. of CHI'04. ACM Press, New York, pp. 1259-1262.
  7. Lambros, S., 2003. SMARTPAD : A Mobile Multimodal Prescription Filling System. A Thesis in TCC 402 University of Virginia.
  8. Oviatt, S., 1999. Ten myths of multimodal interaction, Communications of the ACM, Vol. 42, No. 11, pp. 74- 81.
  9. Oviatt, S., 1999. Mutual disambiguation of recognition errors in a multimodal architecture. Procs. CHI'99. ACM Press: New York, pp. 576-583.
  10. Oviatt, S., 2003. Multimodal interfaces. In The HumanComputer Interaction Handbook: Fundamentals,Evolving Technologies and Emerging Applications, (ed. by J. Jacko and A. Sears), Lawrence Erlbaum Assoc., Mahwah, NJ, chap.14, 286-304.
  11. Sá, M., Carriço, L., 2007. Designing for Mobile Devices: Requirements, Low-Fi Prototyping and Evaluation, Human-Computer Interaction. Interaction Platforms and Techniques. In Procs. HCI International 7807. Vol. 4551/2007, pp. 260-269. Beijing, China.
  12. Santoro, C., Paternò, F., Ricci, G., Leporini, B., 2007. A Multimodal Museum Guide for All. In Mobile interaction with the Real World Workshop, Mobile HCI, Singapore.
  13. Serrano, M., Nigay, L., Demumieux, R., Descos, J., Losquin, P., 2006. Multimodal interaction on mobile phones: development and evaluation using ACICARE. In Procs. Of Mobile HCI'06. Vol. 159, pp 129 - 136, Helsinki, Finland
  14. Signer, B., Norrie, M., Grossniklaus, M., Belotti, R., Decurtins, C., Weibel, N., 2006. PaperBased Mobile Access to Databases. In Procs. of theACM SIGMOD pp: 763-765.

Paper Citation

in Harvard Style

Reis T., de Sá M. and Carriço L. (2008). DESIGNING MOBILE MULTIMODAL ARTEFACTS . In Proceedings of the Tenth International Conference on Enterprise Information Systems - Volume 5: ICEIS, ISBN 978-989-8111-40-1, pages 78-85. DOI: 10.5220/0001708400780085

in Bibtex Style

author={Tiago Reis and Marco de Sá and Luís Carriço},
booktitle={Proceedings of the Tenth International Conference on Enterprise Information Systems - Volume 5: ICEIS,},

in EndNote Style

JO - Proceedings of the Tenth International Conference on Enterprise Information Systems - Volume 5: ICEIS,
SN - 978-989-8111-40-1
AU - Reis T.
AU - de Sá M.
AU - Carriço L.
PY - 2008
SP - 78
EP - 85
DO - 10.5220/0001708400780085