Differentially Expressed Genes Extracted by the Tensor Robust Principal Component Analysis (TRPCA) Method

Dynamic magnetic resonance imaging (dMRI) strikes a balance between reconstruction speed and image accuracy in medical imaging field. In this paper, an improved robust tensor principal component analysis (RTPCA) method is proposed to reconstruct the dynamic magnetic resonance imaging (MRI) from highly under-sampled K-space data. The MR reconstruction problem is formulated as a high-order low-rank tenor plus sparse tensor recovery problem, which is solved by robust tensor principal component analysis (RTPCA) with a new tensor nuclear norm (TNN). To further exploit the low-rank structures in multi-way data, the core matrix nuclear norm, extracted from the diagonal elements of the core tensor under tensor singular value decomposition (t-SVD) framework, is also integrated into TNN for enforcing the low-rank structure in MRI datasets. The experimental results show that the proposed method outperforms state-of-the-art methods in terms of both MR image reconstruction accuracy and computational efficiency on 3D and 4D experiment datasets, especially for 4D MR image reconstruction. Graphical abstract The flowchart of the proposed method to reconstruct the dynamic magnetic resonance imaging (MRI) from highly under-sampled K-space data in the kth iteration. To further exploit the low-rank structures in multi-way data, the core matrix nuclear norm, extracted from the diagonal elements of the core tensor under tensor singular value decomposition (t-SVD) framework, is also integrated into tensor nuclear norm (TNN) for enforcing the low-rank structure in MRI datasets. In each iteration, the first step is to get low-rank tensor ℓk - 1 by using soft thresholding on the singular values of ℓk - 1 = χk - 1 - ξk - 1, and an improved tensor nuclear norm method is proposed to process the low-rank tensor ℓk - 1 firstly. Then, the shrinkage operator is applied to ξk - 1 = χk - 1 - ℓk - 1 for sparse part ξk - 1. The final reconstructed d-MRI χk is obtained by enforcing data consistency that the residual in K-space is subtracted by the sum of the reconstructed low-rank tensor and sparse tensor.

The major challenges during the data acquisition process in an environmental wireless sensor network (EWSN) architecture are the presence of outliers and missing data. Outliers and missing data are ubiquitous in EWSN due to sensor failures, external noise, power dwindling, communication failures etc. Robust tensor principal component analysis (RTPCA) decomposes a noisy data tensor into a low-rank tensor and a sparse tensor, which can be exploited for the data recovery in EWSNs, where the low-rank component represents the intrinsic data tensor and the sparse component represents the gross outlier tensor. In this paper, a novel probabilistic outlier modelling scheme using multivariate Chebyshev's inequality hypothesis is proposed, which maps the sample population and the associated magnitudes of outliers with the spatio-temporal correlations in the acquired data. The inherent spatio-temporal and multi-attribute correlations in the EWSN data are established using singular value methods. A tensor nuclear norm (TNN) which extracts more temporal and multi-attribute correlations in the sensory data through block circulant matricization is used as the minimization function in RTPCA. In the forest surveillance scenario, usage of RTPCA results in a reconstruction accuracy of approximately 90% for a dataset with a high missing ratio of 0.95 and the outliers having largest possible magnitudes considered. For oceanographic data, in which the variance is lower, the simulations show similar performance for different outlier contaminations, although RPTCA performs better than other matrix and tensor data completion methods in terms of reconstruction accuracy.

Infrared small target detection is widely used for early warning, aircraft monitoring, ship monitoring, and so on, which requires the small target and its background to be represented and modeled effectively to achieve their complete separation. Low-rank sparse decomposition based on the structural features of infrared images has attracted much attention among many algorithms because of its good interpretability. Based on our study, we found some shortcomings in existing baseline methods, such as redundancy of constructing tensors and fixed compromising factors. A self-adaptive low-rank sparse tensor decomposition model for infrared dim small target detection is proposed in this paper. In this model, the entropy of image block is used for fast matching of non-local similar blocks to construct a better sparse tensor for small targets. An adaptive strategy of low-rank sparse tensor decomposition is proposed for different background environments, which adaptively determines the weight coefficient to achieve effective separation of background and small targets in different background environments. Tensor robust principal component analysis (TRPCA) was applied to achieve low-rank sparse tensor decomposition to reconstruct small targets and their backgrounds separately. Sufficient experiments on the various types data sets show that the proposed method is competitive.

Nowadays, in the electromagnetism environment, the complex interferences, including the narrowband interferences (NBIs) and wideband interferences (WBIs), may severely affect the imaging quality of synthetic aperture radar (SAR) systems. Most traditional methods can only tackle with one kind of isolated interferences, NBIs or WBIs, which are widely distributed in the 1-D range frequency domain or 2-D range time-frequency domain. In this paper, we propose a complex tensor robust principal component analysis (CT-RPCA) method based on a novel 3-D range-azimuth-space tensor model to mitigate continuously distributed NBIs and WBIs simultaneously. The main contributions of this paper are summarized in three aspects. First, we strictly prove the low-rank property of the isolated NBIs and WBIs in the range-azimuth domain. Second, we use multiple views of the signal to construct a novel 3-D range-azimuth-space tensor model, where both the NBI tensor and the WBI tensor have spatial low-rank property due to the approximately stable frequency bands along the spatial dimension. Third, the CT-RPCA method is employed to efficiently suppress NBIs and WBIs simultaneously by solving the tensor RPCA problem. Finally, the real SAR data with simulated complex interferences are employed to demonstrate the effectiveness of the proposed method.

Probability-weighted tensor robust PCA with CP decomposition for hyperspectral image restoration

In this paper, we propose a method for accurate 3D reconstruction based on Photometric Stereo. Instead of applying the global least square solution on the entire over-determined system, we randomly sample the images to form a set of overlapping groups and recover the surface normal for each group using the least square method. We then employ fourdimensional Tensor Robust Principal Component Analysis (TenRPCA) to obtain the accurate 3D reconstruction. Our method outperforms global least square in handling sparse noises such as shadows and specular highlights. Experiments demonstrate the reconstruction accuracy of our approach.

Many kinds of real-world data, e.g., color images, videos, etc., are represented by tensors and may often be corrupted by outliers. Tensor robust principal component analysis (TRPCA) servers as a tensorial modification of the fundamental principal component analysis (PCA) which performs well in the presence of outliers. The recently proposed TRPCA model [12] based on tubal nuclear norm (TNN) has attracted much attention due to its superiority in many applications. However, TNN is computationally expensive, limiting the application of TRPCA for large tensors. To address this issue, we first propose a new TRPCA model by adopting a factorization strategy within the framework of tensor singular value decomposition (t-SVD). An algorithm based on the non-convex augmented Lagrangian method (ALM) is developed with convergence guarantee. Effectiveness and efficiency of the proposed algorithm is demonstrated through extensive experiments on both synthetic and real datasets.

Robust implementation of foreground extraction and vessel segmentation for X-ray coronary angiography image sequence

As a domain-dependent prior knowledge, side information has been introduced into Robust Principal Component Analysis (RPCA) to alleviate its degenerate or suboptimal performance in some real applications. It has recently realized that the natural structural information can be better retained if the observed data is kept in the original tensor form rather than matricizing it or other order reduction means. Hence, studies on RPCA of tensor version have attracted more and more attentions. To share the merits from both direct tensor modeling and side information, we propose three models to deal with the problem of Tensor RPCA with side information based on tensor Singular Value Decomposition (t-SVD). To solve these models, we develop an efficient algorithm with convergence guarantee using the well-known alternating direction method of multiplier. Extensive experimental studies on both synthetic and real-world tensor data have been carried out to demonstrate the superiority of the proposed models over several other state-of-the-arts. Our code is released at https://github.com/zsj9509/TPCPSF.

Robust tensor principal component analysis extracts the low rank and sparse component of multi-dimensional data by tensor singular value decomposition (t-SVD), which can be used for many data analysis problems. However, the current t-SVD based methods cannot fully extract the low rank component in tensor data, and low rank structure still exists in the core tensor, because t-SVD does not decompose data in the third mode. To fully exploit the low rank structure, we further extract the low rank component using low rank plus sparsity for the core matrix whose entries are from the diagonal elements of the frontal slices in the core tensor. The proposed method is applied to three groups of numerical experiments on image denoising, illumination normalization for face images and motion separation for surveillance videos, respectively, and the results show that the proposed method outperforms state-of-the-art methods in terms of both accuracy and computational complexity.

Tensor Robust Principal Component Analysis (TRPCA) aims at recovering the low-rank and sparse components from target tensor, which has extensive applications in multi-dimensional data recovery. However, most of the existing methods only exploit the global low-rank of image data, which result in missing local details in the recovered data. To restore the data more accurately, we propose a new TRPCA method which simultaneously combines the model-based method and data-driven approaches to preserve the global structure and fine local information. Specially, we pick the tensor nuclear norm to characterize the global correlation and a convolutional neural network(CNN) denoiser which reserves the local detail. Then, a flexible alternating direction method of multipliers (ADMM) is designed to deal with the proposed optimization model. Extensive experiments on various types of tensor data illustrate that our model enhances performance compared to state-of-the-art methods.

This paper introduces a solution for reducing noise data in wireless sensor networks employing a weighted tensor robust principal component analysis (WTRPCA) approach. The proposed method effectively separates the data into normal and abnormal tensors, facilitating identifying corruption and preserving key data components. WTRPCA is specifically designed to optimize this reduced process, and experimental results demonstrate its superior accuracy compared to existing approaches.

In this paper we propose novel methods for completion (from limited samples) and de-noising of multilinear (tensor) data and as an application consider 3-D and 4- D (color) video data completion and de-noising. We exploit the recently proposed tensor-Singular Value Decomposition (t-SVD)[11]. Based on t-SVD, the notion of multilinear rank and a related tensor nuclear norm was proposed in [11] to characterize informational and structural complexity of multilinear data. We first show that videos with linear camera motion can be represented more efficiently using t-SVD compared to the approaches based on vectorizing or flattening of the tensors. Since efficiency in representation implies efficiency in recovery, we outline a tensor nuclear norm penalized algorithm for video completion from missing entries. Application of the proposed algorithm for video recovery from missing entries is shown to yield a superior performance over existing methods. We also consider the problem of tensor robust Principal Component Analysis (PCA) for de-noising 3-D video data from sparse random corruptions. We show superior performance of our method compared to the matrix robust PCA adapted to this setting as proposed in [4].

Many kinds of real-world multi-way signal, like color images, videos, etc., are represented in tensor form and may often be corrupted by outliers. To recover an unknown signal tensor corrupted by outliers, tensor robust principal component analysis (TRPCA) serves as a robust tensorial modification of the fundamental PCA. Recently, a successful TRPCA model based on the tubal nuclear norm (TNN) (Lu et al. in IEEE Trans Pattern Anal Mach Intell 42:925–938, 2019) has attracted much attention thanks to its superiority in many applications. However, TNN is computationally expensive due to the requirement of full singular value decompositions, seriously limiting its scalability to large tensors. To address this issue, we propose a new TRPCA model which adopts a factorization strategy. Algorithmically, an algorithm based on the non-convex augmented Lagrangian method is developed with convergence guarantee. Theoretically, we rigorously establish the sub-optimality of the proposed algorithm. We also extend the proposed model to the robust tensor completion problem. Both the effectiveness and efficiency of the proposed algorithm is demonstrated through extensive experiments on both synthetic and real data sets.

In the era of big data, it is becoming common to have data with multiple modalities or coming from multiple sources, known as "multi-view data". Multi-view data are usually unlabeled and come from high-dimensional spaces (such as language vocabularies), unsupervised multi-view feature selection is crucial to many applications. However, it is nontrivial due to the following challenges. First, there are too many instances or the feature dimensionality is too large. Thus, the data may not fit in memory. How to select useful features with limited memory space? Second, how to select features from streaming data and handles the concept drift? Third, how to leverage the consistent and complementary information from different views to improve the feature selection in the situation when the data are too big or come in as streams? To the best of our knowledge, none of the previous works can solve all the challenges simultaneously. In this paper, we propose an Online unsupervised Multi-View Feature Selection, OMVFS, which deals with large-scale/streaming multi-view data in an online fashion. OMVFS embeds unsupervised feature selection into a clustering algorithm via NMF with sparse learning. It further incorporates the graph regularization to preserve the local structure information and help select discriminative features. Instead of storing all the historical data, OMVFS processes the multi-view data chunk by chunk and aggregates all the necessary information into several small matrices. By using the buffering technique, the proposed OMVFS can reduce the computational and storage cost while taking advantage of the structure information. Furthermore, OMVFS can capture the concept drifts in the data streams. Extensive experiments on four real-world datasets show the effectiveness and efficiency of the proposed OMVFS method. More importantly, OMVFS is about 100 times faster than the off-line methods.