Can Feature Information Interaction Help for Information Fusion in Multimedia Problems?

Jana Kludas, Eric Bruno, Stephane Marchand-Maillet


The article presents the information-theoretic based feature information interaction, a measure that can describe complex feature dependencies in multivariate settings. According to the theoretical development, feature interactions are more accurate than current, bivariate dependence measures due to their stable and unambiguous definition. In experiments with artificial and real data we compare the empirical estimates of correlation, mutual information and 3-way feature interaction. We can conclude that feature interactions give a more detailed and accurate description of data structures that should be exploited for information fusion in multimedia problems.


  1. A. B. Benitez, S. F. Chang, Multimedia knowledge integration, summarization and evaluation, Workshop on Multimedia Data Mining, 2002, pp. 23-26.
  2. E. Bruno, N. Moenne-Loccoz, S. Marchand-Maillet, Design of multimodal dissimilarity spaces for retrieval of multimedia documents, to appear in IEEE Transaction on Pattern Analysis and Machine Intelligence, 2008.
  3. G. Chechik, N. Tishby, Extracting relevant structures with side information, Advances in Neural Information Processing Systems, 15, 2003.
  4. K. Tumer, J. Gosh, Linear order statistics combiners for pattern classification, Combining Artificial Neural Networks, 1999, 127-162.
  5. L. Wu, P.R. Cohen, S.L. Oviatt, From members to team to committee - a robust approach to gestural and multimodal recognition, Transactions on Neural Networks, 13(4), 2002, 972 - 982.
  6. M. M. Kokar, J. Weyman, J.A. Tomasik, Formalizing classes of information fusion systems, Information Fusion, 5, 2004, 189-202.
  7. N. Poh, S. Bengio, How do correlation and variance of base-experts affect fusion in biometric authentication tasks?, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 53, 2005, pp. 4384-4396.
  8. R. Zhao, W. I. Grosky, Narrowing the semantic gap - improved text-based web document retrieval using visual features, IEEE Trans. on Multimedia, 4(2), 2002, 189-200.
  9. S. C. Dass, A. K. Jain, K. Nandakumar, A principled approach to score level fusion in multimodal biometric systems, Proc. of Audio- and Video-based Biometric Person Authentication (AVBPA), 2005, pp. 1049-1058.
  10. S. Wu, S. McClean, Performance prediction of data fusion for information retrieval, Information Processing and Management, 42, 2006, 899-915.
  11. D. M. Squire, W. Mller, H. Mller, and J. Raki, Content-based query of image databases, inspirations from text retrieval: inverted files, frequency-based weights and relevance feedback, in the 10th Scandinavian Conference on Image Analysis (SCIA'99), (Kangerlussuaq, Greenland), 1999, pp. 143-149.
  12. T. Kolenda, O. Winther, L.K. Hansen, J. Larsen, Independent component analysis for understanding multimedia content, Neural Networks for Signal Processing, 2002, 757- 766.
  13. T. Westerveld, A. P. de Vries, Multimedia retrieval using multiple examples, In International Conference on Image and Video Retrieval (CIVR'04), 2004, 344-352.
  14. Y. Wu, K. Chen-Chuan Chang, E. Y. Chang and J. R. Smith, Optimal multimodal fusion for multimedia data analysis, MULTIMEDIA 7804: Proc. of the 12th annual ACM international conference on Multimedia, ACM Press, 2004, pp. 572-579.
  15. R. Yan, A. G. Hauptmann, The combination limit in multimedia retrieval, MULTIMEDIA 7803: Proceedings of the eleventh ACM international conference on Multimedia, ACM Press, 2003, pp. 339-342.
  16. A. Vinokurow, D.R. Hardoon and J. Shawe-Taylor, Learning the Semantics of Multimedia Content with Application to Web Image Retrieval and Classification, in Proceedings of Fourth International Symposium on Independent Component Analysis and Blind Source Separation, Nara, Japan, 2003.
  17. A. Jakulin, I. Bratko, Quantifying and Visualizing Attribute Interactions, ArXiv Computer Science e-prints, Provided by the Smithsonian/NASA Astrophysics Data System, 2003.
  18. A. Jakulin, I. Bratko, Analyzing Attribute Dependencies, Proc. of Principles of Knowledge Discovery in Data (PKDD), 2838, 2003, 229-240.
  19. A. Hyvarinen, E. Oja, Independent Component Analysis: Algorithms and Applications, Neural Networks, 2000, 13(4-5),pp. 411-430.
  20. N. Vasconcelos, G. Carneiro, What is the Role of Independence for Visual Recognition?, European Conference on Computer Vision, Copenhagen, 2002, 297 - 311.
  21. I. Nemenman, Information theory, multivariate dependence and genetic networks, eprint arXiv:q-bio/0406015, ARXIV, 2004.
  22. M.J. Pazzani, Searching for Dependencies in Bayes Classifiers, 1996, Learning from Data: AI and Statistics, Springer Verlag.
  23. A.J. Bell, The Co-Information Lattice, 4th Int. Symposium on Independent Component Analysis and blind Signal Seperation (ICA2003), 2003, pp. 921-926.
  24. T. Westerveld and R. van Zwol, Multimedia Retrieval at INEX 2006, 2007, ACM SIGIR Forum, 41(1), pp. 58-63.
  25. I. Kononenko, E. Simec and M. Robnik-Sikonja, Overcoming the myopia of inductive learning algorithms with RELIEFF, Applied Intelligence, 7(1), 1997, pp. 39-55, Springer Netherlands.
  26. I. Perez, Learning in presence of complex attribute interactions: An Approach Based on Relational Operators, PhD dissertation, University of Illinois at Urbana-Champaign, 1997.
  27. K. Jajuga and D. Papla, Copula Functions in Model Based Clustering, in Studies in Classification, Data Analysis, and Knowledge Organization, Part 15, 2006, Springer Berlin Heidelberg.
  28. T. Liu, Z. Chen, B. Zhang, W. Ma and G. Wu, Improving Text Classification using Local Latent Semantic Indexing, Fourth IEEE International Conference on Data Mining (ICDM'04), pp. 162-169, 2004.

Paper Citation

in Harvard Style

Kludas J., Bruno E. and Marchand-Maillet S. (2008). Can Feature Information Interaction Help for Information Fusion in Multimedia Problems? . In Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008) ISBN 978-989-8111-24-1, pages 23-33. DOI: 10.5220/0002339500230033

in Bibtex Style

author={Jana Kludas and Eric Bruno and Stephane Marchand-Maillet},
title={Can Feature Information Interaction Help for Information Fusion in Multimedia Problems?},
booktitle={Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)},

in EndNote Style

JO - Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)
TI - Can Feature Information Interaction Help for Information Fusion in Multimedia Problems?
SN - 978-989-8111-24-1
AU - Kludas J.
AU - Bruno E.
AU - Marchand-Maillet S.
PY - 2008
SP - 23
EP - 33
DO - 10.5220/0002339500230033