Visual Saliency Detection Using Spatiotemporal Decomposition

• Published in: IEEE transactions on image processing Vol. 27; no. 4; pp. 1665 - 1675
• Main Authors: Bhattacharya, Saumik, Venkatesh, K. Subramanian, Gupta, Sumana
• Format: Journal Article
• Language: English
• Published: United States IEEE 01-04-2018
• Subjects: Color; dominant direction; dynamic video; Feature extraction; Heuristic algorithms; Image color analysis; saliency detection; Spatiotemporal phenomena; Video decomposition; Visualization
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2017.2781305

We propose a novel technique for detection of visual saliency in dynamic video based on video decomposition. The decomposition obtains the sparse features in a particular orientation by exploiting the spatiotemporal discontinuities present in a video cube. A weighted sum of the sparse features along three orthogonal directions determines the salient regions in the video cubes. The weights computed using the frame correlation along three directions are based on the characteristic of human visual system that identifies the sparsest feature as the most salient feature in a video. Unlike the existing methods, which detect the salient region as blob, the proposed approach detects the exact boundaries of salient region with minimum false detection. The experimental results confirm that the detected salient regions of a video closely resemble the salient regions detected by actual tracking of human eyes. The algorithm is tested on different types of video contents and compared with the several state-of-the-art methods to establish the effectiveness of the proposed method.