Authors:
Joël Dumoulin
1
;
Marco Bertini
2
;
Alberto Del Bimbo
2
;
Elena Mugellini
1
;
Omar Abou Khaled
1
and
Maria Sokhn
1
Affiliations:
1
HES-SO, Switzerland
;
2
University of Florence, Italy
Keyword(s):
Automatic Video Annotation, High Level Content Annotation, Multimedia Information Retrieval, Social Video Retrieval, Tag Suggestion, User-generated Content, Smart TV.
Related
Ontology
Subjects/Areas/Topics:
Image and Video Processing, Compression and Segmentation
;
Interactive Multimedia: Games and Digital Television
;
Multimedia
;
Multimedia and Communications
;
Multimedia Databases, Indexing, Recognition and Retrieval
;
Multimedia Signal Processing
;
Multimedia Systems and Applications
;
Semantic Analysis of Multimedia Data
;
Telecommunications
Abstract:
After the advent of smartphones, it is time for television to see its next big evolution, to become smart TVs. But to provide a richer television user experience, multimedia content first has to be enriched. In recent years, the evolution of technology has facilitated the way to take and store multimedia assets, like photographs or videos. This causes an increased difficulty in multimedia resources retrieval, mainly because of the lack of methods that handle non-textual features, both in annotation systems and search engines. Moreover, multimedia sharing websites like Flickr or YouTube, in addition to information provided by Wikipedia, offer a tremendous source of knowledge interesting to be explored. In this position paper, we address the automatic multimedia annotation issue, by proposing a hybrid system approach. We want to use unsupervised methods to find relationships between multimedia elements, referred as hidden topics, and then take advantage of social knowledge to label the
se resulting relationships. Resulting enriched multimedia content will allow to bring new user experience possibilities to the next generation television, allowing for instance the creation of recommender systems that merge this information with user profiles and behavior analysis.
(More)