A New 2D Interaction-based Method for the Behavioral Analysis of Instrumental Activities of Daily Living

Eulalie Verhulst, Déborah Foloppe, Paul Richard, Frédéric Banville, Philippe Allain


In neuropsychology, many computerized solutions have been proposed in order to assess patients’ functioning in activities of daily living, via realistic interactive simulation. In this context, most developed systems are based on simple devices, real time 2D interaction, and monoscopic 3D computer graphics environment. Behavioral analysis has drawn the interest of many domains, such as neuropsychology, ergonomics, web design, or virtual reality. However, advances on this topic remains fragmented in their respective areas. Thus, in computerized solutions applied to neuropsychology, the behavioral analysis does not take into account the data from interaction. The potential interest of computerized solutions is hence underexploited. In this paper, we propose a transdisciplinary solution, based on a finer analysis of 2D interaction data, such as stop duration. This method could reveal interesting aspects of users’ behaviors.


  1. Allain, P., Foloppe, D. A., Besnard, J., Yamaguchi, T., Etcharry-Bouyx, F., Le Gall, D., Nolin, P., and Richard, P. (2014). Detecting everyday action deficits in alzheimer's disease using a nonimmersive virtual reality kitchen. Journal of the International Neuropsychological Society (JINS), 20(5):468-477.
  2. Almanji, A., Davies, T. C., and Stott, N. S. (2014). Using cursor measures to investigate the effects of impairment severity on cursor control for youths with cerebral palsy. International Journal of Human-Computer Studies, 72(3):349-357.
  3. Armstrong, C. M., Reger, G. M., Edwards, J., Rizzo, A. A., Courtney, C. G., and Parsons, T. D. (2013). Validity of the virtual reality stroop task (vrst) in active duty military. Journal of Clinical and Experimental Neuropsychology, 35(2):113-123.
  4. Arnaldi, B., Fuchs, P., and Tisseau, J. (2003). Introduction à la réalité virtuelle (chapitre 1). Les Presses de l'Ecole des Mines, Paris, France.
  5. Banville, F. and Nolin, P. (2012). Using virtual reality to assess prospective memory and executive functions after traumatic brain injury. Journal of Cybertherapy & Rehabilitation, 5(1):45-55.
  6. Besanc¸on, L., Issartel, P., Ammi, M., and Isenberg, T. (2016). Usability Comparison of Mouse, Touch and Tangible Inputs for 3D Data Manipulation.
  7. Burgess, P. W., Alderman, N., Forbes, C., Costello, A., Coates, L. M.-A., Dawson, D. R., Anderson, N. D., Gilbert, S. A. M. J., Dumontheil, I., and Channon, S. (2006). The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology. Journal of the International Neuropsychological Society (JINS), 12(2):”194-209”.
  8. Campbell, Z., Zakzanis, K., D.Jovanovski, Joordens, S., Mraz, R., and Graham, S. J. (2009). Utilizing virtual reality to improve the ecological validity of clinical neuropsychology: an FMRI case study elucidating the neural basis of planning by comparing the tower of london with a three-dimensional navigation task. Applied Neuropsychology, 16:295-306.
  9. Chaytor, N. and Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13(4):”181-197”.
  10. Claypool, M., Le, P., Wased, M., and Brown, D. (2001). Implicit interest indicators. In Proceedings of the 6th International Conference on Intelligent user Interfaces, pages 33-40.
  11. Foloppe, D. A., Richard, P., Yamaguchi, T., EtcharryBouyx, F., and Allain, P. (2015). The potential of virtual reality-based training to enhance the functional autonomy of Alzheimer's disease patients in cooking activities: A single case study. Neuropsychological Rehabilitation, (October):1-25.
  12. Forlines, C., Wigdor, D., C.Shen, and Balakrishnan, R. (2007). Direct-touch vs. mouse input for tabletop displays. In Proceedings of the 2007 Conference on Human Factors in Computing Systems (CHI 2007), San Jose, California, USA, April 28 - May 3, 2007, pages 647-656.
  13. Giovannetti, T., Bettcher, B. M., Brennan, L., Libon, D., Burke, M., Duey, K., Nieves, C., and Wambach, D. (2008). Characterisation of everyday functioning in mild cognitive impairment: A direct assessment approach. Dementia and Geriatric Cognitive Disorders, 25:359-365.
  14. Giovannetti, T., Britnell, P., Brennan, L., Siderowf, A., Grossman, M., Libon, D. J., Bettcher, B. M., Rouzard, F., Eppig, J., and eidel, G. A. (2012). Everyday action impairment in parkinson's disease dementia. Journal of the International Neuropsychological Society (JINS), 18(5):787-98.
  15. Guo, Q. and Agichtein, E. (2008). Exploring mouse movements for inferring query intent. In 31st annual international ACM SIGIR conference on Research and development in information retrieval, pages 707-708.
  16. Harris, H., Bailenson, J. N., Nielsen, A., and Yee, N. (2009). The evolution of social behavior over time in second life. Annual Review of Ecology and Systematics, 5(6):325-383.
  17. Hourcade, J. P. (2006). Learning from preschool children's pointing sub-movements. In Proceedings of the 2006 conference on Interaction design and children, pages 65-72. ACM.
  18. Lawton, M. P. and Brody, E. M. (1969). Assessment of older people: Selfmaintaining and instrumental activities of daily living. Gerontologist, 9(3).
  19. Lewis, M. W., Babbage, D. R., and Leathem, J. M. (2011). Assessing executive performance during cognitive rehabilitation. Neuropsychological Rehabilitation, 21(2):145-163.
  20. Louisy, T., Richard, P., Morin, D., Gall, D. L., and Allain, P. (2003). Virtual kitchen: A virtual environment for assessment and rehabilitation of impaired memory. In Proceedings of the 5th Virtual Reality International Conference (VRIC'03), pages 113 -117, Laval, France.
  21. Motti, V. G. and Caine, K. (2016). Smart wearables or dumb wearables?: Understanding how context impacts the UX in wrist worn interaction. In Proceedings of the 34th ACM International Conference on the Design of Communication, SIGDOC, Silver Spring, MD, USA, September 23-24, 2016, page 10.
  22. Negu,¸t A., Matu, S.-A., Sava, F. A., and David, D. (2016). Task difficulty of virtual reality-based assessment tools compared to classical paper-and-pencil or computerized measures. Computers in Human Behavior, 54(C):414-424.
  23. Richard, P., Massenot, L., Besnard, J., Richard, E., Gall, D. L., and Allain, P. (2010). A virtual kitchen to assess the activities of daily life in alzheimer's disease. In Proceedings of the 5th International Conference on Computer Graphics Theory and Applications (GRAPP 2010), Angers, France, May 17-21, pages 378-383.
  24. Schultheis, M. T., Himelstein, J., and Rizzo, A. A. (2002). Virtual reality and neuropsychology: upgrading the current tools. The Journal of Head Trauma Rehabilitation, 17(5):378-394.
  25. Seelye, A., Hagler, S., Mattek, N., Howieson, D. B., Wild, K., Dodge, H. H., and Kaye, J. A. (2015). Computer mouse movement patterns: A potential marker of mild cognitive impairment. Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring, 1(4):472-480.
  26. Seligman, S. C., Giovannetti, T., Sestito, J., and Libon, D. J. (2014). A new approach to the characterization of subtle errors in everyday action: Implications for mild cognitive impairment. The Clinical Neuropsychologist, 28(1):97-115.
  27. Shapira, B., Taieb-Maimon, M., and Moskowitz, A. (2006). Study of the usefulness of known and new implicit indicators and their optimal combination for accurate inference of users interests. In Proceedings of the 2006 ACM Symposium on Applied Computing, pages 1118- 1119.
  28. Smith, M. W., Sharit, J., and Czaja, S. J. (1999). Aging, motor control, and the performance of computer mouse tasks. Human Factors, 41(3):389-96.
  29. Sousa Santos, B., Dias, P., Pimentel, A., Baggerman, J. W., Ferreira, C., Silva, S., and Madeira, J. (2009). Headmounted display versus desktop for 3D navigation in virtual reality: A user study. Multimedia Tools and Applications, 41(1):161-181.
  30. Teather, R. and Stuerzlinger, W. (2015). Factors affecting mouse-based 3d selection in desktop vr systems. In Proceedings of the ACM Symposium on Spatial User Interaction (SUI), pages 10-19.
  31. Thompson, S. G., McConnell, D. S., Slocum, J. S., and Bohan, M. (2007). Kinematic analysis of multiple constraints on a pointing task. Human movement science, 26(1):11-26.
  32. Verhulst, E., Richard, P., Richard, E., Allain, P., and Nolin, P. (2016). 3D interaction techniques for virtual shopping: Design and preliminary study. In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (GRAPP 2016), pages 271-279.
  33. Ware, C. and Lowther, K. (1997). Selection using a oneeyed cursor in a fish tank vr environment.ACM Transactions on Computer-Human Interaction (TOCHI), 4(4):309-322.
  34. Zhang, L., Abreu, B. C., Seale, G. S., Masel, B., Christiansen, C. H., and Ottenbacher, K. J. (2003). A virtual reality environment for evaluation of a daily living skill in brain injury rehabilitation: Reliability and validity. 84(8):1118-1124.

Paper Citation

in Harvard Style

Verhulst E., Foloppe D., Richard P., Banville F. and Allain P. (2017). A New 2D Interaction-based Method for the Behavioral Analysis of Instrumental Activities of Daily Living . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP, (VISIGRAPP 2017) ISBN 978-989-758-229-5, pages 146-151. DOI: 10.5220/0006255901460151

in Bibtex Style

author={Eulalie Verhulst and Déborah Foloppe and Paul Richard and Frédéric Banville and Philippe Allain},
title={A New 2D Interaction-based Method for the Behavioral Analysis of Instrumental Activities of Daily Living},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP, (VISIGRAPP 2017)},

in EndNote Style

JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: HUCAPP, (VISIGRAPP 2017)
TI - A New 2D Interaction-based Method for the Behavioral Analysis of Instrumental Activities of Daily Living
SN - 978-989-758-229-5
AU - Verhulst E.
AU - Foloppe D.
AU - Richard P.
AU - Banville F.
AU - Allain P.
PY - 2017
SP - 146
EP - 151
DO - 10.5220/0006255901460151