SHARED UNDERSTANDING AND SYNCHRONY EMERGENCE - Synchrony as an Indice of the Exchange of Meaning between Dialog Partners

Ken Prepin, Catherine Pelachaud

2011

Abstract

Synchrony is claimed by psychology as a crucial parameter of any social interaction. In dialog interactions, the synchrony between non-verbal behaviours of interactants is claimed to account for the quality of the interaction: to give to human a feeling of natural interaction, an agent must be able to synchronise on appropriate time. The synchronisation occurring during non-verbal iteractions has recently been modelised as a phenonomenon emerging from the coupling between interactants. We propose here, and test in simulation, a dynamical model of verbal communication which links the emergence of synchrony between non-verbal behaviours to the level of meaning exchanged through words by interactants: if partners of a dyad understand each other, synchrony emerges, whereas if they do not understand, synchrony is disrupted. In addition to retrieve the fact that synchrony emergence within a dyad of agents depends on their level of shared understanding, our tests pointed two noteworthy properties of synchronisation phenomenons: first, as well as synchrony accounts for mutual understanding and good interaction, di-synchrony accounts for misunderstanding; second, synchronisation and di-synchronisation emerging from mutual understanding are very quick phenomenons.

References

  1. Auvray, M., Lenay, C., and Stewart, J. (2009). Perceptual interactions in a minimalist virtual environment. New ideas in psychology, 27:32-47.
  2. Bernieri, F. J. (1988). Coordinated movement and rapport in teacher-student interactions. Journal of Nonverbal Behavior, 12(2):120-138.
  3. Chammat, M., Foucher, A., Nadel, J., and Dubal, S. (2010). Reading sadness beyond human faces. Brain Research, In Press, Accepted Manuscript:-.
  4. Condon, W. S. (1976). An analysis of behavioral organisation. Sign Language Studies, 13:285-318.
  5. Condon, W. S. and Ogston, W. D. (1966). Sound film analysis of normal and pathological behavior patterns. Journal of Nervous and Mental Disease, 143:338- 347.
  6. Dubal, S., Jouvent, A. F. R., and Nadel, J. (2010). Human brain spots emotion in non humanoid robots. Social Cognitive and Affective Neuroscience, in press:-.
  7. Ducan, S. (1972). Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology, 23(2):283-292.
  8. Dumas, G., Nadel, J., Soussignan, R., Martinerie, J., and Garnero, L. (2010). Inter-brain synchonization during social interaction. PLoS One, 5(8):e12166.
  9. Gaussier, P. and Cocquerez, J. (1992). Neural networks for complex scene recognition : simulation of a visual system with several cortical areas. In IJCNN Baltimore, pages 233-259.
  10. Gaussier, P. and Zrehen, S. (1994). Avoiding the world model trap: An acting robot does not need to be so smart! Journal of Robotics and Computer-Integrated Manufacturing, 11(4):279-286.
  11. Hatfield, E., Cacioppo, J. L., and Rapson, R. L. (1993). Emotional contagion. Current Directions in Psychological Sciences, 2:96-99.
  12. Kendon, A. (1990). Conducting Interaction: Patterns of Behavior in Focused Encounters. Cambridge University Press, Cambridge, UK.
  13. LaFrance, M. (1979). Nonverbal synchrony and rapport: Analysis by the cross-lag panel technique. Social Psychology Quarterly, 42(1):66-70.
  14. Matsumoto, D. and Willingham, B. (2009). Spontaneous facial expressions of emotion in congenitally and noncongenitally blind individuals. Journal of Personality and Social Psychology, 96(1):1-10.
  15. Mertan, B., Nadel, J., and Leveau, H. (1993). New perspective in early communicative development, chapter The effect of adult presence on communicative behaviour among toddlers. Routledge, London, UK.
  16. Murray, L. and Trevarthen, C. (1985). Emotional regulation of interactions vetween two-month-olds and their mothers. Social perception in infants, pages 101-125.
  17. Nadel, J. (2002). Imitation and imitation recognition: their functional role in preverbal infants and nonverbal children with autism, pages 42-62. UK: Cambridge University Press.
  18. Nadel, J. and Tremblay-Leveau, H. (1999). Early social cognition, chapter Early perception of social contingencies and interpersonal intentionality: dyadic and triadic paradigms, pages 189-212. Lawrence Erlbaum Associates.
  19. Paolo, E. A. D., Rohde, M., and Iizuka, H. (2008). Sensitivity to social contingency or stability of interaction? modelling the dynamics of perceptual crossing. New ideas in psychology, 26:278-294.
  20. Pelachaud, C. (2009). Modelling multimodal expression of emotion in a virtual agent. Philosophical Transactions of Royal Society. Biological Science, 364:3539-3548.
  21. Pikovsky, A., Rosenblum, M., and Kurths, J. (2001). Synchronization: A Universal Concept in Nonlinear Sciences. Cambridge University Press, Cambridge, UK.
  22. Poggi, I. and Pelachaud, C. (2000). Emotional meaning and expression in animated faces. Lecture Notes in Computer Science, pages 182-195.
  23. Prepin, K. and Gaussier, P. (2010). How an agent can detect and use synchrony parameter of its own interaction with a human? In et al., A. E., editor, COST Action2102, Int. Traing School 2009, Active Listening and Synchrony. LNCS 5967, pages 50-65. SpringerVerlag, Berlin Heidelberg.
  24. Prepin, K. and Revel, A. (2007). Human-machine interaction as a model of machine-machine interaction: how to make machines interact as humans do. Advanced Robotics, 21(15):1709-1723.
  25. Scherer, K. and Delplanque, S. (2009). Emotions, signal processing, and behaviour. In Chemosensory Perception Symposium, Geneva. Firmenich.
  26. Tronick, E., Als, H., Adamson, L., Wise, S., and Brazelton, T. (1978). The infants' response to entrapment between contradictory messages in face-to-face interactions. Journal of the American Academy of Child Psychiatry (Psychiatrics)., 17:1-13.
  27. Yngve, V. H. (1970). On getting a word in edgewise. In Society, C. L., editor, Papers from the 6th regional meeting, pages 567-578.
Download


Paper Citation


in Harvard Style

Prepin K. and Pelachaud C. (2011). SHARED UNDERSTANDING AND SYNCHRONY EMERGENCE - Synchrony as an Indice of the Exchange of Meaning between Dialog Partners . In Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-8425-41-6, pages 25-34. DOI: 10.5220/0003140600250034


in Bibtex Style

@conference{icaart11,
author={Ken Prepin and Catherine Pelachaud},
title={SHARED UNDERSTANDING AND SYNCHRONY EMERGENCE - Synchrony as an Indice of the Exchange of Meaning between Dialog Partners},
booktitle={Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2011},
pages={25-34},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003140600250034},
isbn={978-989-8425-41-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - SHARED UNDERSTANDING AND SYNCHRONY EMERGENCE - Synchrony as an Indice of the Exchange of Meaning between Dialog Partners
SN - 978-989-8425-41-6
AU - Prepin K.
AU - Pelachaud C.
PY - 2011
SP - 25
EP - 34
DO - 10.5220/0003140600250034