EXTRACTION OF RELATIONS BETWEEN LECTURER AND STUDENTS BY USING MULTI-LAYERED NEURAL NETWORKS

Eiji Watanabe, Takashi Ozeki, Takeshi Kohama

Abstract

In this paper, we discuss the extraction of relationships between lecturer and students in lectures by using multi-layered neural networks. First, a few features concerning for behaviors by lecturer and students can be extracted based on image processing. Here, we adopt the following features as behaviors by lecturer and students; the loudness of speech by lecturer, face and hand movements by lecturer, face movements by students. Next, the relations among the above features concerning on their behaviors by lecturer and students can be represented by multi-layered neural networks. Next, we use a learning method with forgetting for neural networks for the purpose of extraction of rules. Finally, we have extracted relationships between behaviors by lecturer and students based on the internal representations in multi-layered neural networks for a real lecture.

References

  1. Hatakeyama, M. and Mori, K. (2001). Interaction between gesture and eye contact in communication. Memoirs of the College of Education, Akita Univ., 56:69-75.
  2. Ishikawa, M. (1996). Structural learning with forgetting. Neural Networks, 9(3):509-521.
  3. Iso, K. (2001). Effects of nonverbal behaviors on the perception of “skillfulness of speech”. Japanese Journal of Interpersonal and Social Psychology, 1:133-146.
  4. Marutani, T., Sugimoto, Y., Kakusyo, K., and Minoh, M. (2007). Lecture context recognition base on statistical feature of lecture action for automatic video recording. IEICE Trans. on Info. & Sys., 90-D(10):2775- 2786.
  5. Rumelhart, D. E. and McClelland, J. L. (1986). Parallel Distributed Processing. MIT Press.
Download


Paper Citation


in Harvard Style

Watanabe E., Ozeki T. and Kohama T. (2011). EXTRACTION OF RELATIONS BETWEEN LECTURER AND STUDENTS BY USING MULTI-LAYERED NEURAL NETWORKS . In Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IMAGAPP, (VISIGRAPP 2011) ISBN 978-989-8425-46-1, pages 75-80. DOI: 10.5220/0003316200750080


in Bibtex Style

@conference{imagapp11,
author={Eiji Watanabe and Takashi Ozeki and Takeshi Kohama},
title={EXTRACTION OF RELATIONS BETWEEN LECTURER AND STUDENTS BY USING MULTI-LAYERED NEURAL NETWORKS},
booktitle={Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IMAGAPP, (VISIGRAPP 2011)},
year={2011},
pages={75-80},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003316200750080},
isbn={978-989-8425-46-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Imaging Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: IMAGAPP, (VISIGRAPP 2011)
TI - EXTRACTION OF RELATIONS BETWEEN LECTURER AND STUDENTS BY USING MULTI-LAYERED NEURAL NETWORKS
SN - 978-989-8425-46-1
AU - Watanabe E.
AU - Ozeki T.
AU - Kohama T.
PY - 2011
SP - 75
EP - 80
DO - 10.5220/0003316200750080