THE MUSIC PAINT MACHINE - A Multimodal Interactive Platform to Stimulate Musical Creativity in Instrumental Practice

Luc Nijs, Pieter Coussement, Chris Muller, Micheline Lesaffre, Marc Leman

2010

Abstract

Interactive music systems offer new possibilities to support instrumental music teaching by providing a corporeally grounded experience as a basis for understanding music and music playing. In this paper we introduce the Music Paint Machine, a device that enables music performers to make a painting on a computer screen by playing their instrument. It is hypothesized that using this application stimulates understanding and creative use of musical parameters.

References

  1. Bamford, A. (2007). Kwaliteit en consistentie. Arts and cultural education in Flanders: CANON Cultural Unit.
  2. Bevilacqua, F., Guédy, F., Schnell, N., Fléty, E., & Leroy, N. (2007). Wireless sensor interface and gesturefollower for music pedagogy. Paper presented at the 7th international conference on New interfaces for musical expression, New York.
  3. Bowman, W. (2000). A somatic," here and now" semantic: Music, body, and self. Bulletin of the Council for Research in Music Education(144), 45-60.
  4. Bowman, W. (2004). Cognition and the body: Perspectives from music education. In L. Bresler (Ed.), Knowing Bodies, Moving Minds: Towards Embodied Teaching and Learning (pp. 29). Dordrecht, The Netherlands: Kluwer Academic Publishers.
  5. Dahlberg, G., Moss, P., & Pence, A. (1999). Beyond quality in early childhood education and care: Postmodern perspectives. London: Routledge.
  6. Davidson, J. (1993). Visual perception of performance manner in the movements of solo musicians. Psychology of Music, 21(2), 103.
  7. Deliège, I., & Wiggins, G. (2006). Musical creativity: multidisciplinary research in theory and practice. New York: Psychology Press.
  8. Elliott, D. (1995). Music matters. A new philosophy of music education. New York: Oxford University Press.
  9. Ernst, M., & Bülthoff, H. (2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8(4), 162-169.
  10. Forsythe, J., & Kelly, M. (1989). Effects of visual-spatial added cues on fourth-graders' melodic discrimination. Journal of Research in Music Education, 37(4), 272.
  11. Frego, D. (1999). Effects of aural and visual conditions on response to perceived artistic tension in music and dance. Journal of Research in Music Education, 47(1), 31.
  12. Gembris, H. (2006). The development of musical abilities. In R. Colwell (Ed.), MENC handbook of musical cognition and development (pp. 124). New York: Oxford University Press.
  13. Gordon, E. (1997). Learning sequences in music: Skill, content, and patterns. Chicago, IL: GIA.
  14. Hidaka, S., Manaka, Y., Teramoto, W., Y, S., Miyauchi, R., Gyoba, J., et al. (2009). Alternation of sound location induces visual motion perception of a static object. PloS One, 4(12).
  15. Kratus, J. (1991). Growing with improvisation. Music Educators Journal, 78(4), 35-40.
  16. Leman, M. (2007). Embodied music cognition and mediation technology. London: The MIT Press.
  17. Lipscomb, S. (2005). The perception of audio-visual composites: Accent structure alignment of simple stimuli. Selected Reports in Ethnomusicology, 12, 37- 67.
  18. MacDonald, M. (2007). Toward formative assessment: The use of pedagogical documentation in early elementary classrooms. Early Childhood Research Quarterly, 22(2), 232-242.
  19. Massumi, B. (2002). Navigating movements. In M. Zournazi (Ed.), Hope: New philosophies for change (pp. 210-244). Annandale, Queensland: Pluto Press.
  20. Naveda, L., & Leman, M. (2009). A Cross-modal Heuristic for Periodic Pattern Analysis of Samba Music and Dance. Journal of New Music Research, 38(3), 255-283.
  21. Ng, K., Larkin, O., Koerselman, T., & Ong, B. (2007). iMaestro gesture and posture support: 3d motion data visualisation for music learning and playing. Paper presented at the EVA 2007 London International Conference, London.
  22. Ng, K., Weyde, T., Larkin, O., Neubarth, K., Koerselman, T., & Ong, B. (2007). 3d augmented mirror: a multimodal interface for string instrument learning and teaching with gesture support. Paper presented at the 9th international conference on Multimodal interfaces, Nagoya, Japan.
  23. Nijs, L. (2008). Evaluatie in het DKO: Het schietlood in actie. Begeleid zelfstandig leren, Alternatieve evaluatie 6(21).
  24. Pierce, A. (2007). Deepening musical performance through movement: the theory and practice of embodied interpretation. Bloomington and Indianapolis: Indiana University Press.
  25. Rogers, G. (1991). Effect of color-coded notation on music achievement of elementary instrumental students. Journal of Research in Music Education, 39(1), 64.
  26. Schutz, M. (2008). Seeing music? What musicians need to know about vision. Empirical Musicology Review, 3, 83-108.
  27. Scott, J. (2007). Me? Teach Improvisation to Children? General Music Today, 20(2), 6-13.
  28. Sloboda, J. (2000). Individual differences in music performance. Trends in Cognitive Sciences, 4(10), 397-403.
  29. Wanderley, M., Vines, B., Middleton, N., McKay, C., & Hatch, W. (2005). The Musical Significance of Clarinetists Ancillary Gestures: An Exploration of the Field. Journal of New Music Research, 34(1), 97-113.
  30. Welch, G., & Adams, P. (2003). How is music learning celebrated and developed? Southwell, Notts: British Educational Research Association.
Download


Paper Citation


in Harvard Style

Nijs L., Coussement P., Muller C., Lesaffre M. and Leman M. (2010). THE MUSIC PAINT MACHINE - A Multimodal Interactive Platform to Stimulate Musical Creativity in Instrumental Practice . In Proceedings of the 2nd International Conference on Computer Supported Education - Volume 1: CSEDU, ISBN 978-989-674-023-8, pages 331-336. DOI: 10.5220/0002859103310336


in Bibtex Style

@conference{csedu10,
author={Luc Nijs and Pieter Coussement and Chris Muller and Micheline Lesaffre and Marc Leman},
title={THE MUSIC PAINT MACHINE - A Multimodal Interactive Platform to Stimulate Musical Creativity in Instrumental Practice },
booktitle={Proceedings of the 2nd International Conference on Computer Supported Education - Volume 1: CSEDU,},
year={2010},
pages={331-336},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002859103310336},
isbn={978-989-674-023-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Computer Supported Education - Volume 1: CSEDU,
TI - THE MUSIC PAINT MACHINE - A Multimodal Interactive Platform to Stimulate Musical Creativity in Instrumental Practice
SN - 978-989-674-023-8
AU - Nijs L.
AU - Coussement P.
AU - Muller C.
AU - Lesaffre M.
AU - Leman M.
PY - 2010
SP - 331
EP - 336
DO - 10.5220/0002859103310336