Adapting Heuristic Evaluation to Information Visualization - A Method for Defining a Heuristic Set by Heuristic Grouping

Maurício Rossi de Oliveira, Celmar Guimarães da Silva

Abstract

Heuristic evaluation technique is a classical evaluation method in Human-Computer Interaction area. Researchers and software developers broadly use it, given that it is fast, cheap and easy to use. Using it in other areas demands creating a new heuristic set able to identify common problems of these areas. Information Visualization (InfoVis) researchers commonly use this technique with the original usability heuristic set proposed by Nielsen, which does not cover many relevant aspects of InfoVis. InfoVis literature presents sets of guidelines that cover InfoVis concepts, but it does not present most of them as heuristics, or they cover much specific concepts. This work presents a method for defining a set of InfoVis heuristics for use in heuristic evaluation. The method clusters heuristics and guidelines found in a literature review, and creates a new heuristic set based on each group. As a result, we created a new set of 15 generic heuristics, from a set of 62 ones, which we hypothesize that will help evaluators to take into account a broad set of visualization aspects during evaluation with possibly less cognitive effort.

References

  1. Amar, R. and Stasko, J. (2004) 'A Knowledge Task-Based Framework for Design and Evaluation of Information Visualizations', in INFOVIS 7804 Proceedings of the IEEE Symposium on Information Visualization. IEEE, pp. 143-150.
  2. Clarkson, E. and Arkin, R. C. (2007) 'Applying heuristic evaluation to human-robot interaction systems', Proceedings of the Twentieth International Florida Artificial Intelligence Research Society (FLAIRS) Conference, pp. 44-49.
  3. Desurvire, H., Caplan, M. and Toth, J. A. (2004) 'Using heuristics to evaluate the playability of games', CHI 7804 Extended Abstracts on Human Factors in Computing Systems, pp. 1509-1512.
  4. Forsell, C. and Johansson, J. (2010) 'An heuristic set for evaluation in information visualization', in Proceedings of the International Conference on Advanced Visual Interfaces - AVI 7810. New York, New York, USA: ACM Press, p. 199.
  5. Franklin, F., Breyer, F. and Kelner, J. (2014) 'Usability Heuristics for Collaborative Augmented Reality Remote Systems', 2014 XVI Symposium on Virtual and Augmented Reality, pp. 53-62.
  6. Freitas, C. M. D. S., Luzzardi, P. R. G., Cava, R. A., Winckler, M. A. A., Pimenta, M. S. and Nedel, L. P. (2002) 'Evaluating Usability of Information Visualization Techniques', Proceedings of 5th Symposium on Human Factors in Computer Systems, pp. 40-51.
  7. Geerts, D. and De Grooff, D. (2009) 'Supporting the social uses of television', in CHI 7809 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. New York, New York, USA: ACM Press, pp. 595-604.
  8. Inostroza, R., Rusu, C., Roncagliolo, S., Jimenez, C. and Rusu, V. (2012) 'Usability Heuristics for Touchscreenbased Mobile Devices', in 2012 Ninth International Conference on Information Technology - New Generations. IEEE, pp. 662-667.
  9. Inostroza, R., Rusu, C., Roncagliolo, S. and Rusu, V. (2013) 'Usability heuristics for touchscreen-based mobile devices: update', in Proceedings of the 2013 Chilean Conference on Human - Computer Interaction - ChileCHI 7813. New York, New York, USA: ACM Press, pp. 24-29..
  10. Inostroza, R., Rusu, C., Roncagliolo, S., Rusu, V. and Collazos, C. A. (2016) 'Developing SMASH: A set of SMArtphone's uSability Heuristics', Computer Standards & Interfaces. Elsevier B.V., 43, pp. 40-52.
  11. Jaferian, P., Hawkey, K., Sotirakopoulos, A., Velez-Rojas, M. and Beznosov, K. (2011) 'Heuristics for evaluating IT security management tools', SOUPS 7811: Proceedings of the Seventh Symposium on Usable Privacy and Security, pp. 1-20.
  12. Kientz, J. A., Choe, E. K., Birch, B., Maharaj, R., Fonville, A., Glasson, C. and Mundt, J. (2010) 'Heuristic evaluation of persuasive health technologies', in Proceedings of the ACM international conference on Health informatics - IHI 7810. New York, New York, USA: ACM Press, pp. 555-564.
  13. Korhonen, H. and Koivisto, E. M. I. (2006) 'Playability heuristics for mobile games', Proceedings of the 8th conference on Humancomputer interaction with mobile devices and services MobileHCI 06, pp. 9-16.
  14. MacFarlane, S. and Pasiali, A. (2005) 'Adapting the Heuristic Evaluation Method for Use with Children', Workshop on Child Computer Interaction: Methodological Research at Interact 2005.
  15. Machado Neto, O. and Pimentel, M. D. G. (2013) 'Heuristics for the assessment of interfaces of mobile devices', in Proceedings of the 19th Brazilian symposium on Multimedia and the web - WebMedia 7813. New York, New York, USA: ACM Press, pp. 93-96.
  16. Mazza, R. (2009) Introduction to Information Visualization. London: Springer London.
  17. Mohamed Omar, H., Yusof, Y. H. H. M. and Sabri, N. M. (2010) 'Development and potential analysis of Heuristic Evaluation for Courseware', Engineering Education (ICEED), 2010 2nd International Congress on, pp. 128-132.
  18. Muñoz, R. and Chalegre, V. (2012) 'Defining virtual worlds usability heuristics', Proceedings of the 9th International Conference on Information Technology, ITNG 2012, pp. 690-695.
  19. Nielsen, J. and Mack, R. L. (1994) Usability Inspection Methods. New York, NY: John Wiley & Sons.
  20. Papaloukas, S., Patriarcheas, K. and Xenos, M. (2009) 'Usability assessment heuristics in new genre videogames', PCI 2009 - 13th Panhellenic Conference on Informatics, pp. 202-206.
  21. Park, K., Goh, T. and So, H.-J. (2014) 'Toward accessible mobile application design: developing mobile application accessibility guidelines for people with visual impairment', Proceedings of HCI Korea, pp. 31- 38.
  22. Pinelle, D., Wong, N., Stach, T. and Gutwin, C. (2009) 'Usability heuristics for networked multiplayer games', in Proceedinfs of the ACM 2009 international conference on Supporting group work - GROUP 7809. New York, New York, USA: ACM Press, pp. 169-178.
  23. Quinones, D., Rusu, C. and Roncagliolo, S. (2014) 'Redefining Usability Heuristics for Transactional Web Applications', 2014 11th International Conference on Information Technology: New Generations, (1), pp. 260-265.
  24. Rusu, C., Roncagliolo, S., Rusu, V. and Collazos, C. (2011) 'A methodology to establish usability heuristics', in 4th International Conference on Advances in ComputerHuman Interactions. Gosier, Guadeloupe; France, pp. 59-62.
  25. Scapin, D. L. and Bastien, J. M. C. (1997) 'Ergonomic criteria for evaluating the ergonomic quality of interactive systems', Behaviour & Information Technology, 16(4-5), pp. 220-231.
  26. Shneiderman, B. (1996) 'The eyes have it: a task by data type taxonomy for information visualizations', in Proceedings 1996 IEEE Symposium on Visual Languages. IEEE Comput. Soc. Press, pp. 336-343.
  27. Silva, C. G. da, Melo, M. F. de, Paula e Silva, F. de and Meidanis, J. (2014) 'PQR sort: using PQR trees for binary matrix reorganization', Journal of the Brazilian Computer Society, 20:3(1).
  28. Soomro, S., Ahmad, W. F. W. and Sulaiman, S. (2012) 'A preliminary study on heuristics for mobile games', in 2012 International Conference on Computer & Information Science (ICCIS). IEEE, pp. 1030-1035.
  29. de Souza, C. S., Leitão, C. F., Prates, R. O. and da Silva, E. J. (2006) 'The semiotic inspection method', in Proceedings of VII Brazilian symposium on Human factors in computing systems - IHC 7806. New York, New York, USA: ACM Press, pp. 148-157.
  30. Weiss, A., Wurhofer, D., Bernhaupt, R., Altmaninger, M. and Tscheligi, M. (2010) 'A methodological adaptation for heuristic evaluation of HRI', in 19th International Symposium in Robot and Human Interactive Communication. IEEE, pp. 1-6.
  31. Zuk, T. and Carpendale, S. (2006) 'Theoretical analysis of uncertainty visualizations', Electronic Imaging 2006, 6060(March), pp. 1-14.
Download


Paper Citation


in Harvard Style

Rossi de Oliveira M. and Guimarães da Silva C. (2017). Adapting Heuristic Evaluation to Information Visualization - A Method for Defining a Heuristic Set by Heuristic Grouping . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017) ISBN 978-989-758-228-8, pages 225-232. DOI: 10.5220/0006133202250232


in Bibtex Style

@conference{ivapp17,
author={Maurício Rossi de Oliveira and Celmar Guimarães da Silva},
title={Adapting Heuristic Evaluation to Information Visualization - A Method for Defining a Heuristic Set by Heuristic Grouping},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017)},
year={2017},
pages={225-232},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006133202250232},
isbn={978-989-758-228-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017)
TI - Adapting Heuristic Evaluation to Information Visualization - A Method for Defining a Heuristic Set by Heuristic Grouping
SN - 978-989-758-228-8
AU - Rossi de Oliveira M.
AU - Guimarães da Silva C.
PY - 2017
SP - 225
EP - 232
DO - 10.5220/0006133202250232