What energy functions can be minimized via graph cuts?

• Published in: IEEE transactions on pattern analysis and machine intelligence Vol. 26; no. 2; pp. 147 - 159
• Main Authors: Kolmogorov, V., Zabin, R.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01-02-2004; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Application software; Artificial Intelligence; Computer Graphics; Computer vision; Dynamic programming; Image Enhancement - methods; Image Interpretation, Computer-Assisted - methods; Image reconstruction; Image restoration; Imaging, Three-Dimensional - methods; Information Storage and Retrieval - methods; Layout; Markov random fields; Minimization methods; Numerical Analysis, Computer-Assisted; Pattern Recognition, Automated; Reproducibility of Results; Sensitivity and Specificity; Signal Processing, Computer-Assisted; Stereo image processing; Stereo vision; Studies; Subtraction Technique; User-Computer Interface
• ISSN: 0162-8828; 1939-3539
• DOI: 10.1109/TPAMI.2004.1262177

In the last few years, several new algorithms based on graph cuts have been developed to solve energy minimization problems in computer vision. Each of these techniques constructs a graph such that the minimum cut on the graph also minimizes the energy. Yet, because these graph constructions are complex and highly specific to a particular energy function, graph cuts have seen limited application to date. In this paper, we give a characterization of the energy functions that can be minimized by graph cuts. Our results are restricted to functions of binary variables. However, our work generalizes many previous constructions and is easily applicable to vision problems that involve large numbers of labels, such as stereo, motion, image restoration, and scene reconstruction. We give a precise characterization of what energy functions can be minimized using graph cuts, among the energy functions that can be written as a sum of terms containing three or fewer binary variables. We also provide a general-purpose construction to minimize such an energy function. Finally, we give a necessary condition for any energy function of binary variables to be minimized by graph cuts. Researchers who are considering the use of graph cuts to optimize a particular energy function can use our results to determine if this is possible and then follow our construction to create the appropriate graph. A software implementation is freely available.