A Smart Visual Information Tool for Situational Awareness

Marco Vernier, Manuela Farinosi, Gian Luca Foresti

Abstract

In the last years, social media have grown in popularity with millions of users that everyday produce and share online digital content. This practice reveals to be particularly useful in extra-ordinary context, such as during a disaster, when the data posted by people can be integrated with traditional emergency management tools and used for event detection and hyperlocal situational awareness. In this contribution, we present SVISAT, an innovative visualization system for Twitter data mining, expressly conceived for signaling in real time a given event through the uploading and sharing of visual information (i.e., photos). Using geodata, it allows to display on a map the wide area where the event is happening, showing at the same time the most popular hashtags adopted by people to spread the tweets and the most relevant images/photos which describe the event itself.

References

  1. Abel, F., Hauff, C., Houben, G.-j., Tao, K., and Stronkman, R. (2012). Semantics + Filtering + Search = Twitcident Exploring Information in Social Web Streams Categories and Subject Descriptors. In 23rd ACM Conference on Hypertext and Social Media, HT'12, pages 285-294.
  2. Ashktorab, Z., Brown, C., and Culotta, A. (2014). Tweedr: Mining Twitter to Inform Disaster Response. In S.R. Hiltz, M.S. Pfaff, L. Plotnick, and P.C. Shih, editor, Proceedings of the 11th International ISCRAM Conference, number May, pages 354-358, University Park, Pennsylvania, USA.
  3. Bay, H., Ess, A., Tuytelaars, T., and Van Gool, L. (2008). Speeded-up robust features (surf). Computer Vision and Image Understanding, 110(3):346-359.
  4. Bruns, A. and Burgess, J. (2013). Crisis Communication in Natural Disasters: The Queensland Floods and Christchurch Earthquakes.
  5. Bruns, A., Burgess, J., Crawford, K., and Shaw, F. (2012). # qldfloods and @ QPSMedia : Crisis Communication on Twitter in the 2011 South East Queensland Floods. Number Cci. ARC Centre of Excellence for Creative Industries and Innovation, Brisbane.
  6. Cameron, M. a., Power, R., Robinson, B., and Yin, J. (2012). Emergency situation awareness from twitter for crisis management. Proceedings of the 21st international conference companion on World Wide Web - WWW 7812 Companion, page 695.
  7. Farinosi, M. and Trere, E. (2014). Challenging mainstream media, documenting real life and sharing with the community: An analysis of the motivations for producing citizen journalism in a post-disaster city. Global Media and Communication, 10(1):73-92.
  8. Foresti, G., Farinosi, M., and Vernier, M. (2015). Situational awareness in smart environments: socio-mobile and sensor data fusion for emergency response to disasters. Journal of Ambient Intelligence and Humanized Computing, 6(2):239-257.
  9. Garcia, J., Martinel, N., Foresti, G. L., Gardel, A., and Micheloni, C. (2014). Person Orientation and Feature Distances Boost Re-identification. In International Conference on Pattern Recognition, pages 4618-4623. IEEE.
  10. Gupta, A., Lamba, H., Kumaraguru, P., and Joshi, A. (2013). Faking Sandy: characterizing and identifying fake images on Twitter during Hurricane Sandy.
  11. Proceedings of the 22nd International Conference on World Wide Web, pages 729-736.
  12. Hughes, A. and Palen, L. (2009). Twitter adoption and use in mass convergence and emergency events. International Journal of Emergency Management, 6(3- 4):248-260.
  13. Johnston, L. and Marrone, M. (2009). Twitter user becomes star in US Airways crash, in New York Daily News.
  14. Klein, B., Laiseca, X., Casado-Mansilla, D., López-DeIpi n˜a, D., and Nespral, A. P. (2012). Detection and extracting of emergency knowledge from twitter streams. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), volume 7656 LNCS, pages 462-469.
  15. Latonero, M. and Shklovski, I. (2010). ”Respectfully Yours in Safety and Service”: Emergency Management & Social Media Evangelism. In Proceedings of the 7th International ISCRAM Conference, number May, pages 1-10.
  16. Li, R., Lei, K. H., Khadiwala, R., and Chang, K. C. C. (2012). TEDAS: A twitter-based event detection and analysis system. In Proceedings - International Conference on Data Engineering, pages 1273-1276.
  17. Martinel, N., Avola, D., Piciarelli, C., Micheloni, C., Vernier, M., Cinque, L., and Foresti, G. L. (2015a). Selection of Temporal Features for Event Detection in Smart Security. In International Conference on Image Analysis and Processing, pages 609-619.
  18. Martinel, N., Das, A., Micheloni, C., and Roy-Chowdhury, A. K. (2015b). Re-Identification in the Function Space of Feature Warps. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(8):1656-1669.
  19. Martinel, N. and Foresti, G. L. (2012). Multi-signature based person re-identification. Electronics Letters, 48(13):765.
  20. Martinel, N. and Micheloni, C. (2014). Sparse Matching of Random Patches for Person Re-Identification. In International Conference on Distributed Smart Cameras, pages 1-6.
  21. Martinel, N., Micheloni, C., and Foresti, G. L. (2013). Robust Painting Recognition and Registration for Mobile Augmented Reality. IEEE Signal Processing Letters, 20(11):1022-1025.
  22. Martinel, N., Micheloni, C., and Foresti, G. L. (2015c). Evolution of Neural Learning Systems. System Man and Cybernetics Magazine, pages 1-6.
  23. Martinel, N., Micheloni, C., and Foresti, G. L. (2015d). Saliency Weighted Features for Person Reidentification. InEuropean Conference Computer Vision Workshops and Demonstrations, pages 191-208.
  24. Martinel, N., Micheloni, C., Piciarelli, C., and Foresti, G. L. (2014). Camera Selection for Adaptive HumanComputer Interface. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 44(5):653-664.
  25. Martinel, N., Piciarelli, C., Micheloni, C., and Foresti, G. L. (2015e). A Structured Committee for Food Recognition. In International Conference on Computer Vision Workshops.
  26. Moore, a. (2001). K-means and Hierarchical Clustering. Statistical Data Mining Tutorials, pages 1-24.
  27. Procopio, C. H. and Procopio, S. T. (2007). Do You Know What It Means to Miss New Orleans? Internet Communication, Geographic Community, and Social Capital in Crisis.
  28. Sakaki, T., Okazaki, M., and Matsuo, Y. (2010). Earthquake shakes Twitter users: real-time event detection by social sensors. In WWW 7810: Proceedings of the 19th international conference on World wide web, page 851.
  29. Sweetser, K. D. and Metzgar, E. (2007). Communicating during crisis: Use of blogs as a relationship management tool. Public Relations Review, 33(3):340-342.
  30. Vieweg, S., Hughes, A. L., Starbird, K., and Palen, L. (2010). Microblogging during two natural hazards events: what twitter may contribute to situational awareness. In CHI 2010: Crisis Informatics April 1015, 2010, Atlanta, GA, USA, pages 1079-1088.
Download


Paper Citation


in Harvard Style

Vernier M., Farinosi M. and Foresti G. (2016). A Smart Visual Information Tool for Situational Awareness . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 236-245. DOI: 10.5220/0005680402360245


in Bibtex Style

@conference{visapp16,
author={Marco Vernier and Manuela Farinosi and Gian Luca Foresti},
title={A Smart Visual Information Tool for Situational Awareness},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={236-245},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005680402360245},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - A Smart Visual Information Tool for Situational Awareness
SN - 978-989-758-175-5
AU - Vernier M.
AU - Farinosi M.
AU - Foresti G.
PY - 2016
SP - 236
EP - 245
DO - 10.5220/0005680402360245