Efficient Implementation of Truncated Frobenius Norm Minimization for Latent Low-Rank Representation
Subspaceclustering (SC), which aims to cluster the high-dimensional data samples into their exclusive low-dimensional subspaces, has been widely used in data mining and computer vision. However, an in-depth study of existing models reveals that most of them ignore the prior rank information of the encountered problem, which prevents them from effectively extracting the inherent features embedded in the data. To this end, a <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">t</u>runcated <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">F</u>robenius norm minimization-based <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">lat</u>ent <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">l</u>ow-<underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">r</u>ank <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">r</u>epresentation (TFLatLRR) model is proposed for SC. Our proposed model can not only sufficiently preserve the crucial data components within the truncated rank, but also characterize a global subspace structure of data in the presence of deficiency and occlusions. Thus, a more accurate and effective representation matrix can be learned by TFLatLRR, and its corresponding affinity can be quantitatively measured by the newly defined <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">B</u>lock <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">D</u>ensity <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">I</u>ndex (BDI). More importantly, we theoretically demonstrate that the global optimum of the <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">S</u>quare of <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">T</u>runcated <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">S</u>ingular <underline xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">V</u>alues (STSV) operator can be directly achieved in closed form, rather than transforming the corresponding problem into a convex optimization problem. Then, an efficacious algorithm is devised to solve the proposed model by employing the alternating direction method of multipliers (ADMM) framework, where each subproblem can be efficiently solved in closed form. Furthermore, a rigorous mathematical proof shows that the sequence produced by the proposed algorithm converges to a Karush-Kuhn-Tucker (KKT) point. Experimental results on several real-world datasets demonstrate the superiority of our model in comparison with state-of-the-art models.
Read more