A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed \ell ^ Norm

• Published in: IEEE transactions on signal processing Vol. 57; no. 1; pp. 289 - 301
• Main Authors: Mohimani, H., Babaie-Zadeh, M., Jutten, C.
• Format: Journal Article
• Language: English
• Published: IEEE 01-01-2009
• Subjects: Atomic decomposition; Blind source separation; blind source separation (BSS); Compressed sensing; Decoding; Dictionaries; Equations; Linearity; overcomplete signal representation; Signal processing algorithms; Source separation; sparse component analysis (SCA); sparse decomposition; Sparse matrices; sparse source separation; Vectors
• ISSN: 1053-587X; 1941-0476
• DOI: 10.1109/TSP.2008.2007606

In this paper, a fast algorithm for overcomplete sparse decomposition, called SL0, is proposed. The algorithm is essentially a method for obtaining sparse solutions of underdetermined systems of linear equations, and its applications include underdetermined sparse component analysis (SCA), atomic decomposition on overcomplete dictionaries, compressed sensing, and decoding real field codes. Contrary to previous methods, which usually solve this problem by minimizing the l 1 norm using linear programming (LP) techniques, our algorithm tries to directly minimize the l 1 norm. It is experimentally shown that the proposed algorithm is about two to three orders of magnitude faster than the state-of-the-art interior-point LP solvers, while providing the same (or better) accuracy.