Authors:
Volker Willert
1
and
Julian Eggert
2
Affiliations:
1
TU Darmstadt, Germany
;
2
Honda Research Institute, Germany
Keyword(s):
Early Vision, Dynamical Vision, Belief Propagation, MRF, DBN, Denoising.
Related
Ontology
Subjects/Areas/Topics:
Applications
;
Computer Vision, Visualization and Computer Graphics
;
Early Vision and Image Representation
;
Enhancement and Restoration
;
Image and Video Analysis
;
Image Formation and Preprocessing
;
Pattern Recognition
;
Segmentation and Grouping
;
Software Engineering
;
Statistical Approach
;
Video Analysis
Abstract:
Belief Propagation (BP) is an efficient approximate inference technique both for Markov Random Fields (MRF) and Dynamic Bayesian Networks (DBN). 2DMRFs provide a unified framework for early vision problems that are based on static image observations. 3D MRFs are suggested to cope with dynamic image data. To the contrary, DBNs are far less used for dynamic low level vision problems even though they represent sequences of state variables and hence are suitable to process image sequences with temporally changing visual information. In this paper, we propose a 3D DBN topology for dynamic visual processing with a product of potentials as transition probabilities. We derive an efficient update rule for this 3D DBN topology that unrolls loopy BP for a 2D MRF over time and compare it to update rules for conventional 3D MRF topologies. The advantages of the 3D DBN are discussed in terms of memory consumptions, costs, convergence and online applicability. To evaluate the performance of inferin
g visual information from dynamic visual observations, we show examples for image sequence denoising that achieve MRF-like accuracy on real world data.
(More)