Authors:
Kohei Kawade
1
;
Akihiro Wakita
1
;
Tastuya Yokota
1
;
Hidekata Hontani
1
and
Shigeru Ando
2
Affiliations:
1
Nagoya Institute of Technology, Japan
;
2
Richo Elemex Corporation, Japan
Keyword(s):
Optical Flow, Correlation Image Sensor.
Related
Ontology
Subjects/Areas/Topics:
Computer Vision, Visualization and Computer Graphics
;
Motion, Tracking and Stereo Vision
;
Optical Flow and Motion Analyses
Abstract:
We propose a method that restores a temporal image sequence, which describes how a scene temporally changed during the exposure period, from a given still image captured by a correlation image sensor (CIS). The restored images have higher spatial resolutions than the original still image, and the restored temporal sequence would be useful for motion analysis in applications such as landmark tracking and video labeling. The CIS is different from conventional image sensors because each pixel of the CIS can directly measure the Fourier coefficients of the temporal change of the light intensity observed during the exposure period. Given a single image captured by the CIS, hence, one can restore the temporal image sequence by computing the Fourier series of the temporal change of the light strength at each pixel. Through this temporal sequence restoration, one can also reduce motion blur. The proposed method improves the performance of motion blur reduction by estimating the Fourier coeff
icients of the frequencies higher than the measured ones. In this work, we show that the Fourier coefficients of the higher frequencies can be estimated based on the optical flow constraint. Some experimental results with images captured by the CIS are demonstrated.
(More)