Geometric Occlusion Analysis in Depth Estimation Using Integral Guided Filter for Light-Field Image

• Published in: IEEE transactions on image processing Vol. 26; no. 12; pp. 5758 - 5771
• Main Authors: Sheng, Hao, Zhang, Shuo, Cao, Xiaochun, Fang, Yajun, Xiong, Zhang
• Format: Journal Article
• Language: English
• Published: United States IEEE 01-12-2017
• Subjects: boundary similarity; Cameras; depth estimation; Estimation; Geometric occlusion analysis; Image color analysis; Image resolution; Integral equations; integral guided filter; light field; Robustness
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2017.2745100

Unlike traditional multi-view images, sampling in angular domain of light field images is distributed in different directions. Therefore, an angular sampling image (ASI), comprising of possible matching points extracted from each view, is available for each point. In this paper, we analyze the geometric relationship between ASIs and reference sub-aperture images, and then prove the occlusion boundary similarity. Based on the geometric relationship in extreme cases, we show that some points in ASI have higher reliability than other points for depth calculation. An integral guided filter is then built based on the sub-aperture image to predict occlusion probabilities in ASIs. The filter is independent of ASIs and has no requirement for high angular resolution so that it is easy to apply to the cost volume calculation. We integrate the filter into our depth estimation framework and other state-of-the-art depth estimation frameworks. Experimental results demonstrate that the proposed filter is more effective to occluded point detection in ASIs than other methods. Results from different data sets show that our method outperforms the existing state-of-the-art depth estimation methods, especially along occlusion boundaries.