TOWARDS AFFORDABLE GESTURE BASED INTERFACES - An Exploration with Wii Remotes

Amy Ciavolino, Camille Marvin, Jason Creighton, James Coddington, Hans-Peter Bischof, Reynold Bailey

Abstract

The traditional keyboard and mouse computer interface is well suited for 2D applications such as document editing, but as 3D environments become more prevalent there arises a need for new methods of user input. An immersive 3D interface is preferable, but is often cost prohibitive. This paper presents the design and implementation of a Natural User Interface (NUI), named NuWii. NuWii was designed to be used with the Spiegel visualization framework for astrophysical data. The interface makes use of Nintendo Wii Remotes as infrared tracking cameras to detect 3D gestures made by the user. These gestures are interpreted and used to control the viewing camera’s parameters throughout the course of a visualization. Our project provides a new, more intuitive way of manipulating the camera in the Spiegel visualization system. Furthermore, NuWii provides an expandable base that could be used for gesture control in many other applications.

References

  1. Bak, A. (2004). 3d input devices for the grapecluster project. Independent study report, Rochester Institute of Technology.
  2. Bischof, H.-P. (2010). The Spiegel Project. http://spiegel.cs. rit.edu/ hpb/grapecluster/Spiegel/index.html.
  3. Bischof, H.-P., Dale, E., and Peterson, T. (2006). Spiegel - a visualization framework for large and small scale systems. In Arabnia, H. R., editor, Proceedings of the 2006 International Conference on Modeling, Simulation and Visualization Methods, pages 199-205. CSREA Press.
  4. Cuypers, T., Van den Eede, T., Ligot, S., and Francken, Y. (2009). Stereowiision: Stereo vision with wiimotes. In Proceedings of 3D Stereo MEDIA 2009.
  5. Dehling, E. (2008). Using multiple wiimote cameras to control a game. Master's thesis, University of Twente.
  6. Hay, S., Newman, J., and Harle, R. (2008). Optical tracking using commodity hardware. In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 7808, pages 159-160, Washington, DC, USA. IEEE Computer Society.
  7. Lee, J. C. (2008). Hacking the nintendo wii remote. IEEE Pervasive Computing, 7:39-45.
  8. Underkoffler, J. (2010). John underkoffler points to the future of ui. Talk at TED 2010.
  9. Wang, D. and Huang, D. (2008). Low-cost motion capturing using nintendo wii remote controllers. Csc2228 project report, University of Toronto, Toronto, Ontario M5S 3G4.
  10. Wang, R. Y. and Popovic, J. (2009). Real-time handtracking with a color glove. In SIGGRAPH 7809: ACM SIGGRAPH 2009 papers, pages 1-8, New York, NY, USA. ACM.
  11. Wii Brew, C. (2010). Wiimote. http://wiibrew.org/wiki/ Wiimote.
Download


Paper Citation


in Harvard Style

Ciavolino A., Marvin C., Creighton J., Coddington J., Bischof H. and Bailey R. (2011). TOWARDS AFFORDABLE GESTURE BASED INTERFACES - An Exploration with Wii Remotes . In Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2011) ISBN 978-989-8425-46-1, pages 224-229. DOI: 10.5220/0003322102240229


in Bibtex Style

@conference{ivapp11,
author={Amy Ciavolino and Camille Marvin and Jason Creighton and James Coddington and Hans-Peter Bischof and Reynold Bailey},
title={TOWARDS AFFORDABLE GESTURE BASED INTERFACES - An Exploration with Wii Remotes},
booktitle={Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2011)},
year={2011},
pages={224-229},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003322102240229},
isbn={978-989-8425-46-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IVAPP, (VISIGRAPP 2011)
TI - TOWARDS AFFORDABLE GESTURE BASED INTERFACES - An Exploration with Wii Remotes
SN - 978-989-8425-46-1
AU - Ciavolino A.
AU - Marvin C.
AU - Creighton J.
AU - Coddington J.
AU - Bischof H.
AU - Bailey R.
PY - 2011
SP - 224
EP - 229
DO - 10.5220/0003322102240229