To Kick or Not to Kick: An Affective Computing Question

Luca Casaburi, Francesco Colace, Carmine Di Gruttola, Donato Di Stasi


With the Web 2.0 and its services, the users are able to express their own emotions through the production and sharing of multimedia contents. In this context, we can interpret the flood of selfies that everyday invades the web as the will to overcome the limits of the textual communication. Therefore, it becomes particularly interesting the possibility to extract in an automatic way information about the emotional state of the people present in the multimedia content. The knowledge of a person’s emotional state gives useful information for the personalization of many online services. Some examples of the areas where such an approach can be adopted are the services for the content recommendation, for the entertainment and for the distance training. In this paper, the techniques of sentiment extraction from multimedia contents will be applied to the sports world. In particular, the aim is to verify the possibility to predict the result of a penalty kick analyzing the player’s face. The objective is to investigate the possibility to evaluate in real time the psychic conditions of an athlete during a competition. The system has been tested on an opportunely built dataset and the results are more than satisfying.


  1. Tao, J., Tieniu, T., 2005, Affective Computing: A Review, Affective Computing and Intelligent Interaction, LNCS 3784, Springer, pp. 981-995.
  2. Ekman, P., Friesen, W., 1978, Facial Action Coding System: A Technique for the Measurement of Facial Movement, Consulting Psychologists Press.
  3. Chang, Y., Changbo, Hu, Turk, M., 2004, Probabilistic expression analysis on manifolds, In Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition, CVPR'04, pp. 520-527.
  4. Zhang, Z., Lyons, M., Schuster, M., Akamatsu, S., 1998, Comparison Between Geometry-based and Gaborwavelets-based Facial Expression Recognition Using Multi-layer Perceptron, Third IEEE Intel. Conf. On Automatic Face and Gesture Recognition, pp. 454-459.
  5. Elad, A., Kimmel, R., 2003, On bending invariant signatures for surfaces, IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 25, Issue: 10, pp. 1285-1295.
  6. Deng, H., Jin, L., Zhen, L., Huang, J., 2005, A New Facial Expression Recognition Method Based on Local Gabor Filter Bank and PCA plus LDA, International Journal of Information Technology, Vol. 11 No. 11, pp. 86-96.
  7. Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S., 2003, Facial Expression Recognition From Video Sequences: Temporal and Static Modeling, Computer Vision and Image Understanding, pp. 160-187.
  8. Lee, K., Ho, J., Yang, M.H., Kriegman, D., 2003, Videobased Face Recognition Using Probabilistic Appearance Manifolds, Conference on Computer Vision and Pattern Recognition, pp. 313-320.
  9. Wang, H., Ahuja, N., 2003, Facial Expression Decomposition, Proceedings of the Ninth IEEE International Conference on Computer Vision (ICCV'03), vol.2, pp. 958-965.
  10. Casaburi, L., Colace, F., De Santo, M., Greco, L., 2015, Magic mirror in my hand, what is the sentiment in the lens?”: An action unit based approach for mining sentiments from multimedia contents, Journal of Visual Languages & Computing, 27, pp. 19-28.
  11. Hamm, J., Kohler, C. G., Gur, R. C., Verma, R., 2011, Automated Facial Action Coding System for dynamic analysis of facial expressions in neuropsychiatric disorders, Journal of Neuroscience Methods 200 (2), pp. 237-256.
  12. Cohn, J. F., Reed, L. I., Ambadar, Z., Xiao, J., Moriyama T., 2004, Automatic Analysis and Recognition of Brow Actions and Head Motion in Spontaneous Facial Behavior, IEEE International Conference on Systems, Man and Cybernetics, pp. 610-616.
  13. J. F. Cohn, J. F., Lucey, S., Saragih, J., Lucey, P., De la Torre, F., 2009, Automated Facial Expression Recognition System, IEEE International Carnahan Conference on Security Technology, pp. 172-177.
  14. El Kaliouby, R., Robinson P., 2004, Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures, In Proc. Int'l Conf. Computer Vision & Pattern Recognition, pp. 181-200.
  15. Amato, F., Colace, F., Greco, L., Moscato, V., Picariello, A., 2016, Semantic processing of multimedia data for e-government applications, J. Vis. Lang. Comput. 32: pp. 35-41.
  16. Colace, F., Casaburi, L., De Santo, M, Greco, L., 2015, Sentiment detection in social networks and in collaborative learning environments, Computers in Human Behavior 51: pp. 1061-1067.

Paper Citation

in Harvard Style

Casaburi L., Colace F., Di Gruttola C. and Di Stasi D. (2016). To Kick or Not to Kick: An Affective Computing Question . In Proceedings of the 18th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-187-8, pages 415-420. DOI: 10.5220/0005825804150420

in Bibtex Style

author={Luca Casaburi and Francesco Colace and Carmine Di Gruttola and Donato Di Stasi},
title={To Kick or Not to Kick: An Affective Computing Question},
booktitle={Proceedings of the 18th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},

in EndNote Style

JO - Proceedings of the 18th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - To Kick or Not to Kick: An Affective Computing Question
SN - 978-989-758-187-8
AU - Casaburi L.
AU - Colace F.
AU - Di Gruttola C.
AU - Di Stasi D.
PY - 2016
SP - 415
EP - 420
DO - 10.5220/0005825804150420