Chapter 6 - Tensor principal component analysis

Dynamic magnetic resonance imaging (dMRI) strikes a balance between reconstruction speed and image accuracy in medical imaging field. In this paper, an improved robust tensor principal component analysis (RTPCA) method is proposed to reconstruct the dynamic magnetic resonance imaging (MRI) from highly under-sampled K-space data. The MR reconstruction problem is formulated as a high-order low-rank tenor plus sparse tensor recovery problem, which is solved by robust tensor principal component analysis (RTPCA) with a new tensor nuclear norm (TNN). To further exploit the low-rank structures in multi-way data, the core matrix nuclear norm, extracted from the diagonal elements of the core tensor under tensor singular value decomposition (t-SVD) framework, is also integrated into TNN for enforcing the low-rank structure in MRI datasets. The experimental results show that the proposed method outperforms state-of-the-art methods in terms of both MR image reconstruction accuracy and computational efficiency on 3D and 4D experiment datasets, especially for 4D MR image reconstruction. Graphical abstract The flowchart of the proposed method to reconstruct the dynamic magnetic resonance imaging (MRI) from highly under-sampled K-space data in the kth iteration. To further exploit the low-rank structures in multi-way data, the core matrix nuclear norm, extracted from the diagonal elements of the core tensor under tensor singular value decomposition (t-SVD) framework, is also integrated into tensor nuclear norm (TNN) for enforcing the low-rank structure in MRI datasets. In each iteration, the first step is to get low-rank tensor ℓk - 1 by using soft thresholding on the singular values of ℓk - 1 = χk - 1 - ξk - 1, and an improved tensor nuclear norm method is proposed to process the low-rank tensor ℓk - 1 firstly. Then, the shrinkage operator is applied to ξk - 1 = χk - 1 - ℓk - 1 for sparse part ξk - 1. The final reconstructed d-MRI χk is obtained by enforcing data consistency that the residual in K-space is subtracted by the sum of the reconstructed low-rank tensor and sparse tensor.

As a domain-dependent prior knowledge, side information has been introduced into Robust Principal Component Analysis (RPCA) to alleviate its degenerate or suboptimal performance in some real applications. It has recently realized that the natural structural information can be better retained if the observed data is kept in the original tensor form rather than matricizing it or other order reduction means. Hence, studies on RPCA of tensor version have attracted more and more attentions. To share the merits from both direct tensor modeling and side information, we propose three models to deal with the problem of Tensor RPCA with side information based on tensor Singular Value Decomposition (t-SVD). To solve these models, we develop an efficient algorithm with convergence guarantee using the well-known alternating direction method of multiplier. Extensive experimental studies on both synthetic and real-world tensor data have been carried out to demonstrate the superiority of the proposed models over several other state-of-the-arts. Our code is released at https://github.com/zsj9509/TPCPSF.

Robust tensor principal component analysis extracts the low rank and sparse component of multi-dimensional data by tensor singular value decomposition (t-SVD), which can be used for many data analysis problems. However, the current t-SVD based methods cannot fully extract the low rank component in tensor data, and low rank structure still exists in the core tensor, because t-SVD does not decompose data in the third mode. To fully exploit the low rank structure, we further extract the low rank component using low rank plus sparsity for the core matrix whose entries are from the diagonal elements of the frontal slices in the core tensor. The proposed method is applied to three groups of numerical experiments on image denoising, illumination normalization for face images and motion separation for surveillance videos, respectively, and the results show that the proposed method outperforms state-of-the-art methods in terms of both accuracy and computational complexity.

The major challenges during the data acquisition process in an environmental wireless sensor network (EWSN) architecture are the presence of outliers and missing data. Outliers and missing data are ubiquitous in EWSN due to sensor failures, external noise, power dwindling, communication failures etc. Robust tensor principal component analysis (RTPCA) decomposes a noisy data tensor into a low-rank tensor and a sparse tensor, which can be exploited for the data recovery in EWSNs, where the low-rank component represents the intrinsic data tensor and the sparse component represents the gross outlier tensor. In this paper, a novel probabilistic outlier modelling scheme using multivariate Chebyshev's inequality hypothesis is proposed, which maps the sample population and the associated magnitudes of outliers with the spatio-temporal correlations in the acquired data. The inherent spatio-temporal and multi-attribute correlations in the EWSN data are established using singular value methods. A tensor nuclear norm (TNN) which extracts more temporal and multi-attribute correlations in the sensory data through block circulant matricization is used as the minimization function in RTPCA. In the forest surveillance scenario, usage of RTPCA results in a reconstruction accuracy of approximately 90% for a dataset with a high missing ratio of 0.95 and the outliers having largest possible magnitudes considered. For oceanographic data, in which the variance is lower, the simulations show similar performance for different outlier contaminations, although RPTCA performs better than other matrix and tensor data completion methods in terms of reconstruction accuracy.

Many kinds of real-world data, e.g., color images, videos, etc., are represented by tensors and may often be corrupted by outliers. Tensor robust principal component analysis (TRPCA) servers as a tensorial modification of the fundamental principal component analysis (PCA) which performs well in the presence of outliers. The recently proposed TRPCA model [12] based on tubal nuclear norm (TNN) has attracted much attention due to its superiority in many applications. However, TNN is computationally expensive, limiting the application of TRPCA for large tensors. To address this issue, we first propose a new TRPCA model by adopting a factorization strategy within the framework of tensor singular value decomposition (t-SVD). An algorithm based on the non-convex augmented Lagrangian method (ALM) is developed with convergence guarantee. Effectiveness and efficiency of the proposed algorithm is demonstrated through extensive experiments on both synthetic and real datasets.

In this paper we propose novel methods for completion (from limited samples) and de-noising of multilinear (tensor) data and as an application consider 3-D and 4- D (color) video data completion and de-noising. We exploit the recently proposed tensor-Singular Value Decomposition (t-SVD)[11]. Based on t-SVD, the notion of multilinear rank and a related tensor nuclear norm was proposed in [11] to characterize informational and structural complexity of multilinear data. We first show that videos with linear camera motion can be represented more efficiently using t-SVD compared to the approaches based on vectorizing or flattening of the tensors. Since efficiency in representation implies efficiency in recovery, we outline a tensor nuclear norm penalized algorithm for video completion from missing entries. Application of the proposed algorithm for video recovery from missing entries is shown to yield a superior performance over existing methods. We also consider the problem of tensor robust Principal Component Analysis (PCA) for de-noising 3-D video data from sparse random corruptions. We show superior performance of our method compared to the matrix robust PCA adapted to this setting as proposed in [4].

In the big data era, sequencing technology has produced a large number of biological sequencing data. Different views of the cancer genome data provide sufficient complementary information to explore genetic activity. The identification of differentially expressed genes from multiview cancer gene data is of great importance in cancer diagnosis and treatment. In this paper, we propose a novel method for identifying differentially expressed genes based on tensor robust principal component analysis (TRPCA), which extends the matrix method to the processing of multiway data. To identify differentially expressed genes, the plan is carried out as follows. First, multiview data containing cancer gene expression data from different sources are prepared. Second, the original tensor is decomposed into a sum of a low‐rank tensor and a sparse tensor using TRPCA. Third, the differentially expressed genes are considered to be sparse perturbed signals and then identified based on the sparse tensor. Fourth, the differentially expressed genes are evaluated using Gene Ontology and Gene Cards tools. The validity of the TRPCA method was tested using two sets of multiview data. The experimental results showed that our method is superior to the representative methods in efficiency and accuracy aspects.

The process monitoring and quality control of metal additive manufacturing has been a research hotspot in recent years. AI-driven laser powder bed fusion process monitoring is currently the most popular research idea. However, machine learning methods have high requirements for data sets and require a lot of cost. Therefore, this paper attempts to use a new technology, namely tensor robust principal component analysis, to directly analyze and process powder bed images, to realize the extraction of powder bed defects. The main steps include: 1) synthesizing a large number of powder bed images into a tensor; 2) separating the tensor into low-rank components and sparse components. By analyzing and processing the powder bed images collected during the two printing processes and the powder bed images with serious defects collected during a long period, the problems and suitable use scenarios of tensor robust principal component analysis in dealing with powder bed defects are discussed. It is found that it has the best effect in dealing with continuous powder bed images with variable defects.

Tensor low-rank representation (TLRR) has attracted increasing attention in recent years due to its effectiveness in capturing the intrinsic low-rank structure of tensor data. However, it is known that TLRR suffers from high computational complexity for large-scale data because it minimizes the tensor rank of the representation tensor whose size is proportional to the sample size. This paper develops a streaming algorithm—termed online low-rank tensor subspace clustering (OLRTSC)—for low-rank tensor data recovery and clustering based on the tensor singular value decomposition (t-SVD) algebraic framework. The key idea of OLRTSC is the non-convex reformulation of the objective function of TLRR by decomposing the tensor nuclear norm into an explicit tensor product of two low-rank tensors, which can be solved by leveraging the stochastic optimization technique. Compared to batch TLRR, OLRTSC is online by nature, can handle dynamic data, avoids computing t-SVD of the representation tensor, and reduces the storage cost significantly. This paper provides the theoretical guarantee that the sequence of the solutions produced by OLRTSC converges almost surely to a stationary point of the objective function. Moreover, an extension of OLRTSC is also proposed to handle the case when parts of the data are missing. Finally, experimental results on both synthetic and real data demonstrate the efficiency and robustness of the proposed approaches.

In paper, we focus on the computation of the principal components for a general tensor, known as the tensor principal component analysis (PCA) problem. It has been proven that the general tensor PCA problem is reducible to its matricization form when the order is even. Usually it is considered as low-rank matrix completion problems theoretically. It is common to consider nuclear norm as a surrogate of the rank operator since it is the tightest convex lower bound of the rank operator under certain condition. However, most nuclear norm minimization based approaches involve numbers of singular value decomposition (SVD) operations. Given a matrix X E Rm× n, the time complexity of SVD operation is O(mn2), which brings prohibitive computational burden to apply these methods in real applications. However, the problem is non-convex, and the proximal mapping associated with non-convex regularization is not easy to compute. It is always solved by the Linearized Alternating Direction Method of Multipliers (LADMM). Despite the success of LADMM in practice, it remains unknown if LADMM is convergent in solving such non-convex compositely regularized optimization. In this paper, we firstly present a detailed convergence analysis of the LADMM algorithm for solving non-convex compositely regularized optimization with a large class of non-convex penalties. Furthermore, we propose a new efficient and scalable algorithm for matrix principal component analysis called Proximal Linearized Alternating Direction Method of Multipliers for Principal Component Analysis(PLADMPCA). Different from traditional matrix factorization methods, PLADMPCA utilizes the linearization technique to formulate the matrix as an outer product of vectors, which greatly improves the computational efficacy compared to matrix factorization method. We empirically evaluate the proposed algorithm PLADMPCA on synthetic tensor data with different order. Results have shown that PLADMPCA have much better computational cost to matrix factorization based method. At the same time, it outperforms the state-of-art SVD based matrix completion algorithms by similar or better reconstruction accuracy with enormous advantages on efficiency.

In this paper, we propose a method for accurate 3D reconstruction based on Photometric Stereo. Instead of applying the global least square solution on the entire over-determined system, we randomly sample the images to form a set of overlapping groups and recover the surface normal for each group using the least square method. We then employ fourdimensional Tensor Robust Principal Component Analysis (TenRPCA) to obtain the accurate 3D reconstruction. Our method outperforms global least square in handling sparse noises such as shadows and specular highlights. Experiments demonstrate the reconstruction accuracy of our approach.

Many kinds of real-world multi-way signal, like color images, videos, etc., are represented in tensor form and may often be corrupted by outliers. To recover an unknown signal tensor corrupted by outliers, tensor robust principal component analysis (TRPCA) serves as a robust tensorial modification of the fundamental PCA. Recently, a successful TRPCA model based on the tubal nuclear norm (TNN) (Lu et al. in IEEE Trans Pattern Anal Mach Intell 42:925–938, 2019) has attracted much attention thanks to its superiority in many applications. However, TNN is computationally expensive due to the requirement of full singular value decompositions, seriously limiting its scalability to large tensors. To address this issue, we propose a new TRPCA model which adopts a factorization strategy. Algorithmically, an algorithm based on the non-convex augmented Lagrangian method is developed with convergence guarantee. Theoretically, we rigorously establish the sub-optimality of the proposed algorithm. We also extend the proposed model to the robust tensor completion problem. Both the effectiveness and efficiency of the proposed algorithm is demonstrated through extensive experiments on both synthetic and real data sets.

Nowadays, some tensor-based hyperspectral anomaly detection (HAD) approaches are still insufficient in utilizing the spatial-spectral structure information of hyperspectral images (HSIs), resulting in the inability to isolate the background and abnormal targets well. In this letter, an enhanced tensor low-rank representation learning (ETLR) model is proposed for HAD. Specifically, the original 3-D hyperspectral image (HSI) data is firstly decomposed into a structural background component, an anomaly component and a noise component. Among them, with the help of multi-subspace learning technology, the structural background component is reformulated by the t-product of the background dictionary tensor and the corresponding coefficient tensor. Then, tensor nuclear norm (TNN) is adopted to preserve the global low-rank property of the background component in both spatial and spectral dimensions. For the abnormal component, an ℓ <sub xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2,1,1</sub> -norm is designed to enhance the group sparsity of abnormal pixels. For the noise component, a tensor <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">F</i> -norm constraint is imposed to suppress the confusion of noise and anomalies. Meanwhile, a robust dictionary tensor that can adequately characterize the background is constructed by using tensor robust principal component analysis (TRPCA). Furthermore, to reduce the interference of redundant information on detection accuracy, the optimal clustering framework (OCF) method is utilized for band selection. Finally, extensive experiments on one simulated and three real HSI datasets confirm that our algorithm is superior than current HAD algorithms.

Tensor Robust Principal Component Analysis (TRPCA) aims at recovering the low-rank and sparse components from target tensor, which has extensive applications in multi-dimensional data recovery. However, most of the existing methods only exploit the global low-rank of image data, which result in missing local details in the recovered data. To restore the data more accurately, we propose a new TRPCA method which simultaneously combines the model-based method and data-driven approaches to preserve the global structure and fine local information. Specially, we pick the tensor nuclear norm to characterize the global correlation and a convolutional neural network(CNN) denoiser which reserves the local detail. Then, a flexible alternating direction method of multipliers (ADMM) is designed to deal with the proposed optimization model. Extensive experiments on various types of tensor data illustrate that our model enhances performance compared to state-of-the-art methods.

Principal Component Analysis (PCA) is a widely used dimensional reduction method that aims to find a low dimension sub space of highly correlated data for its major information to be used in further analysis. Machine learning methods based on PCA are popular in high dimensional data analysis, such as video and image processing. In video processing, the Robust PCA (RPCA), which is a modified method of the traditional PCA, has good properties in separating moving objects from the background, but it may have difficulties in separating those when light intensity of the background varies significantly in time. To overcome the difficulties, a modified PCA method, called Regression PCA (RegPCA), is proposed. The method is developed by combining the traditional PCA and regression approaches together, and it can be easily combined with RPCA for video processing. We focus the presentation of RegPCA with the combination of RPCA on video processing and find that it is more reliable than RPCA only. We use RegPCA to separate moving object from the background in a color video and get a better result than that given by RPCA. In the implementation, we first derive the explanatory variables by the background information. we then process a number of frames of the video and use those as a set of response variables. We remove the impact of the background by regressing the response against the explanatory variables by a regression model. The regression model provides a set of residuals, which can be further analyzed by RPCA. We compare the results of RegRPCA against those of RPCA only. It is evident that the moving objects can be completely removed from the background using our method but not in RPCA. Note that our result is based on a combination of RegPCA with RPCA. Our proposed method provides a new implementation of RPCA under the framework of regression approaches, which can be used to account for the impact of risk factors. This problem cannot be addressed by the application of RPCA only.