Interacting with our Environment through Sentient Mobile Phones

Diego López de Ipiña, Iñaki Vázquez, David Sainz


The latest mobile phones are offering more multimedia features, better communication capabilities (Bluetooth, GPRS, 3G) and are far more easily programmable (extensible) than ever before. So far, the “killer apps” to exploit these new capabilities have been presented in the form of MMS (Multimedia Messaging), video conferencing and multimedia-on-demand services. We deem that a new promising application domain for the latest Smart Phones is their use as intermediaries between us and our surrounding environment. Thus, our mobiles will behave as personal butlers who assist us in our daily tasks, taking advantage of the computational services provided at our working or living environments. For this to happen, a key element is to add senses to our mobiles: capability to see (camera), hear (michrophone), notice (Bluetooth) the objects and devices offering computational services. In this paper, we present a solution to this issue, the MobileSense system. We illustrate its use in two scenarios: (1) making mobiles more accessible to people with disabilities and (2) enabling the mobiles as guiding devices within a museum.


  1. Shadbolt N. Ambient Intelligence. IEEE Intelligent Systems, July/August 2003 (2003) 2-3
  2. Weiser M. The Computer for the 21st Century. Scientific American, (1992) vol. 265, no. 3, pp. 94-104.
  3. Bluetooth.
  4. Hopper, A. The Clifford Paterson Lecture, 1999 Sentient Computing. Philosophical Transactions of the Royal Society London, vol. 358, no. 1773, pp. 2349-2358, August 2000.
  5. Hightower J., Borriello G. Location Systems for Ubiquitous Computing. IEEE Computer 2001; 34(8): 57-66
  6. López de Ipiña D., Mendonça P. and Hopper A. TRIP: a Low-Cost Vision-Based Location System for Ubiquitous Computing. Personal and Ubiquitous Computing, Springer, vol. 6, no. 3, pp. 206-219, May 2002. Software downloadable at:
  7. Java 2 Platform, Micro Edition (J2ME).
  8. Symbian OS: The Mobile Operating System.
  9. Blue Cove: An open source implementation of the JSR-82 Bluetooth API for Java,
  10. TALKS for Series and Nokia Communicator,, 2004
  11. OWASYS 22C y 112C,, 2004
  12. FreeTTS 1.2beta2,, 2004
  13. Schulenburg J., GOCR,, 2004
  14. Walker w. et al., Sphinx-4: A Flexible Open Source Framework for Speech Recognition, http://cmusphinx.sourceforge. net/sphinx4/doc/Sphinx4Whitepaper.pdf, 2004
  15. Iftode L, Borcea C., Ravi N., Kang N., and Zhou P. Smart Phone: An Embedded System for Universal Interactions, Proceedings of 10th International Workshop on Future Trends in Distributed Computing Systems FTDCS (2004).
  16. Want R., et al. The Personal Server: Changing the Way We Think about Ubiquitous ComputingIn Proceedings of Ubicomp2002, pp. 194-209. Springer LNCS, September 2003.
  17. Kindberg T., Baron J., et al. People, places, things: Web presence for the real world. 3rd IEEE Workshop on Mobile Computing Systems and Applications, December 2000.
  18. Rohs M., Gfeller B., Using Camera-Equipped Mobile Phones for Interacting with RealWorld Objects. Advances in Pervasive Computing, Austrian Computer Society (OCG), ISBN 3-85403-176-9, pp. 265-271, Vienna, Austria, April 2004
  19. López de Ipiña et al. Accesibilidad para Discapacitados a través de Teléfonos y Servicios Móviles Adaptables. JANT 2004, Bilbao, SPAIN, Diciembre 2004.

Paper Citation

in Harvard Style

López de Ipiña D., Vázquez I. and Sainz D. (2005). Interacting with our Environment through Sentient Mobile Phones . In Proceedings of the 2nd International Workshop on Ubiquitous Computing - Volume 1: IWUC, (ICEIS 2005) ISBN 972-8865-24-4, pages 19-27. DOI: 10.5220/0002564000190027

in Bibtex Style

author={Diego López de Ipiña and Iñaki Vázquez and David Sainz},
title={Interacting with our Environment through Sentient Mobile Phones},
booktitle={Proceedings of the 2nd International Workshop on Ubiquitous Computing - Volume 1: IWUC, (ICEIS 2005)},

in EndNote Style

JO - Proceedings of the 2nd International Workshop on Ubiquitous Computing - Volume 1: IWUC, (ICEIS 2005)
TI - Interacting with our Environment through Sentient Mobile Phones
SN - 972-8865-24-4
AU - López de Ipiña D.
AU - Vázquez I.
AU - Sainz D.
PY - 2005
SP - 19
EP - 27
DO - 10.5220/0002564000190027