- Research Article
250
- 10.1016/j.imavis.2005.09.010
Nonlinear structure tensors
- Nov 30, 2005
- Image and Vision Computing
- Thomas Brox + 3 more +3
Nonlinear structure tensors
We present an anisotropic filtering scheme which uses a nonlinear version of the local structure tensor to dynamically adapt the shape of the neighborhood used to perform the estimation. In this way, only the samples along the orthogonal direction to that of maximum signal variation are chosen to estimate the value at the current position, which helps to better preserve boundaries and structure information. This idea sets the basis of an anisotropic filtering framework which can be applied for different kinds of linear filters, such as Wiener or LMMSE, among others. In this paper, we describe the underlying idea using anisotropic gaussian filtering which allows us, at the same time, to study the influence of nonlinear structure tensors in filtering schemes, as we compare the performance to that obtained with classical definitions of the structure tensor.
Nonlinear structure tensors
Nonlinear structure tensors
Structure-Adaptive Anisotropic Filter with Local Structure Tensors
We propose a new structure-adaptive anisotropic filtering scheme based on the local structure tensor. We utilize the local structure tensor to measure image local anisotropic features and estimate the orientation of image structures, and these informations are then used to shape and control the anisotropic Gaussian kernel. The proposed filter denoises noisy images while image structures such as corners, junctions and edges are well preserved. Our experimental results clearly show that the proposed scheme outperforms some other adaptive filters such as the adaptive Wiener filter, Weickert’s edge enhancing diffusion (EED) filter and Yang's structure-adaptive anisotropic filter in terms of both mean square errors (MSE) and visual quality, and the one based on the nonlinear structure tensor (NLST) can give much better denoising results than that based on the linear structure tensor (LST), particularly in edge regions.
Read moreA Multi-scale Bilateral Structure Tensor Based Corner Detector
In this paper, a novel multi-scale nonlinear structure tensor based corner detection algorithm is proposed to improve effectively the classical Harris corner detector. By considering both the spatial and gradient distances of neighboring pixels, a nonlinear bilateral structure tensor is constructed to examine the image local pattern. It can be seen that the linear structure tensor used in the original Harris corner detector is a special case of the proposed bilateral one by considering only the spatial distance. Moreover, a multi-scale filtering scheme is developed to tell the trivial structures from true corners based on their different characteristics in multiple scales. The comparison between the proposed approach and four representative and state-of-the-art corner detectors shows that our method has much better performance in terms of both detection rate and localization accuracy.
Read moreSkeleton Extraction via Structure-Adaptive Anisotropic Filtering
Skeletonization of gray-scale images is a challenging problem in computer vision due to the non-uniform width of shape and the clutter background. This paper presents a novel approach of skeletonization for gray-scale images directly from original image based on anisotropic Gaussian filter. To deal with the non-uniform width of natural object parts, we adapt the shape of filter kernel to local gradient feature. The orientation of filter is firstly estimated based on local structure tensor, and then the scale is calculated based on gradient vector flux. After that, the anisotropic Gaussian filter is performed on the image. The skeleton strength map is defined by the gradient vector flux measure. Finally, thin and binary skeleton is obtained by non-maximum suppression the skeleton strength map. Our method performs well on both binary and gray image in skeleton extraction even for clutter image.
Read moreA Novel Structure Tensor Using Nonlocal Total Variation Operator
The structure tensor known as a second moment matrix which integrates the local data information of the image. It has been a well-established tool in the image processing field. To date a variety of nonlinear structure tensors have been emerged. Among them, the non-local structure tensors (NLSTs) is the focus of researching for the reason that it explores the spatial interactions in images. However, the performance of the existing NLST in image analysis is limited. In this paper, we propose a new structure tensor calculation method by using the nonlocal means filter to smooth the matrix-valued data. The resulting nonlocal structure tensor is effective in the orientation estimation and structural analysis of the image. Meanwhile, the nonlocal TV model based this structure tensor has been successfully applied in noise removal. Experimental results show that our model has better performance in preserving the structures, details and textures.
Read moreNoise-resistant structure-preserving multiscale image decomposition
A challenge for current edge-preserving image decompositions is to deal with noisy images. Gradient- or magnitude difference-based techniques regard the noise boundary as edges, while the local extrema-based method suffers from averaging noisy envelops. We introduce local anisotropy derived from nonlinear local structure tensor to differentiate edges from fine-scale details and noises. Providing low smoothness weights to the places with large local anisotropy rather than a large gradient under the improved weighted least squares optimization framework, we present a noise-resistant, structure-preserving smoothing operator. By either progressively or recursively applying this operator we construct our structure-preserving multiscale image decomposition. Based on the key property of our algorithm, noise resistance, we compare our results with existing edge-preserving image decomposition methods and demonstrate the effectiveness and robustness of our structure-preserving decompositions in the context of image restoration, noisy image abstraction, and noisy image dehazing.
Read moreTensor Processing for Texture and Colour Segmentation
In this paper, we propose an original approach for texture and colour segmentation based on the tensor processing of the nonlinear structure tensor. While the tensor structure is a well established tool for image segmentation, its advantages were only partly used because of the vector processing of that information. In this work, we use more appropriate definitions of tensor distance grounded in concepts from information theory and compare their performance on a large number of images. We clearly show that the traditional Frobenius norm-based tensor distance is not the most appropriate one. Symmetrized KL divergence and Riemannian distance intrinsic to the manifold of the symmetric positive definite matrices are tested and compared. Adding to that, the extended structure tensor and the compact structure tensor are two new concepts that we present to incorporate gray or colour information without losing the tensor properties. The performance and the superiority of the Riemannian based approach over some recent studies are demonstrated on a large number of gray-level and colour data sets as well as real images.KeywordsColour ImageSegmentation MethodGeodesic DistanceStructure TensorTexture SegmentationThese keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Read moreAn Image Denoising Technique Using Wavelet-Anisotropic Gaussian Filter-Based Denoising Convolutional Neural Network for CT Images
Denoising computed tomography (CT) medical images is crucial in preserving information and restoring images contaminated with noise. Standard filters have extensively been used for noise removal and fine details’ preservation. During the transmission of medical images, noise degrades the visibility of anatomical structures and subtle abnormalities, making it difficult for radiologists to accurately diagnose and interpret medical conditions. In recent studies, an optimum denoising filter using the wavelet threshold and deep-CNN was used to eliminate Gaussian noise in CT images using the image quality index (IQI) and peak signal-to-noise ratio (PSNR). Although the results were better than those with traditional techniques, the performance resulted in a loss of clarity and fine details’ preservation that rendered the CT images unsuitable. To address these challenges, this paper focuses on eliminating noise in CT scan images corrupted with additive Gaussian blur noise (AGBN) using an ensemble approach that integrates anisotropic Gaussian filter (AGF) and wavelet transform with a deep learning denoising convolutional neural network (DnCNN). First, the noisy image is denoised by AGF and Haar wavelet transform as preprocessing operations to eliminate AGBN. The DnCNN is then combined with AGF and wavelet for post-processing operation to eliminate the rest of the noises. Specifically, we used AGF due to its adaptability to edge orientation and directional information, which prevents blurring along edges for non-uniform noise distribution. Denoised images are evaluated using PSNR, mean squared error (MSE), and the structural similarity index measure (SSIM). Results revealed that the average PSNR value of the proposed ensemble approach is 28.28, and the average computational time is 0.01666 s. The implication is that the MSE between the original and reconstructed images is very low, implying that the image is restored correctly. Since the SSIM values are between 0 and 1.0, 1.0 perfectly matches the reconstructed image with the original image. In addition, the SSIM values at 1.0 or near 1.0 implicitly reveal a remarkable structural similarity between the denoised CT image and the original image. Compared to other techniques, the proposed ensemble approach has demonstrated exceptional performance in maintaining the quality of the image and fine details’ preservation.
Read moreDesigning palmprint based recognition system using local structure tensor and force field transformation for human identification
Designing palmprint based recognition system using local structure tensor and force field transformation for human identification
Read moreCoarse-to-fine optical flow estimation with image structure tensor
This paper proposes a novel coarse-to-fine optical flow method based on the image local structure tensor. The data term of the optical flow model is projected by combining the proposed structure tensor constancy assumption and the grey value constancy assumption with the robust penalty function, and an isotropic nonlinear function is planned to smoothing term. With the coarse-to-fine multiscale warping strategy, a linear iteration scheme is established. Several experimental results of the Middlebury sequences show that the presented method is high accuracy and good robustness.
Read moreTwo-dimensional multi-pixel anisotropic Gaussian filter for edge-line segment (ELS) detection
Two-dimensional multi-pixel anisotropic Gaussian filter for edge-line segment (ELS) detection
Seismic data filtering using non-local means algorithm based on structure tensor
Non-Local means algorithm is a new and effective filtering method. It calculates weights of all similar neighborhoods’ center points relative to filtering point within searching range by Gaussian weighted Euclidean distance between neighborhoods, then gets filtering point’s value by weighted average to complete the filtering operation. In this paper, geometric distance of neighborhood’s center point is taken into account in the distance measure calculation, making the non-local means algorithm more reasonable. Furthermore, in order to better protect the geometry structure information of seismic data, we introduce structure tensor that can depict the local geometrical features of seismic data. The coherence measure, which reflects image local contrast, is extracted from the structure tensor, is integrated into the non-local means algorithm to participate in the weight calculation, the control factor of geometry structure similarity is added to form a non-local means filtering algorithm based on structure tensor. The experimental results prove that the algorithm can effectively restrain noise, with strong anti-noise and amplitude preservation effect, improving PSNR and protecting structure information of seismic image. The method has been successfully applied in seismic data processing, indicating that it is a new and effective technique to conduct the structure-preserved filtering of seismic data.
Read moreACTIVE CONTOUR BASED ON 3D STRUCTURE TENSOR APPLIED IN MEDICAL IMAGE SEGMENTATION
The paper presents an improved tensor-based active contour model in a variational level set formulation for medical image segmentation. In it, a new energy function is defined with a local intensity fitting term in intensity inhomogeneity of the image, and with a global intensity fitting term in intensity homogeneity domain. Weighting factor is chosen to balance these two intensity fitting terms, which can be calculated automatically by local entropy. The level set regularization term is to replace contour curve to find the minimum of the energy function. Particularly, structure tensor is applied to describe the image, which overcomes the disadvantage of image feature without structure information. The experimental results show that our proposed method can segment image efficiently whether it presents intensity inhomogeneity or not and wherever the initial contour is. Moreover, compared with the Chan–Vese model and local binary fitting model, our proposed model not only handles better intensity inhomogeneity, but also is less sensitive to the location of initial contour.
Read moreESTIMATING FIBRE DIRECTION DISTRIBUTIONS OF REINFORCED COMPOSITES FROM TOMOGRAPHIC IMAGES
Fibre reinforced composites constitute a relevant class of materials used chiefly in lightweight constructions for example in fuselages or car bodies. The spatial arrangement of the fibres and in particular their direction distribution have huge impact on macroscopic properties and, thus, its determination is an important topic of material characterisation. The fibre direction distribution is defined on the unit sphere, and it is therefore preferable to work with fully three-dimensional images of the microstructure as obtained, e.g., by computed micro-tomography. A number of recent image analysis algorithms exploit local grey value variations to estimate a preferred direction in each fibre point. Averaging these local results leads estimates of the volume-weighted fibre direction distribution. We show how the thus derived fibre direction distribution is related to quantities commonly used in engineering applications. Furthermore, we discuss four algorithms for local orientation analysis, namely those based on the response of anisotropic Gaussian filters, moments and axes of inertia derived from directed distance transforms, the structure tensor, or the Hessian matrix. Finally, the feasibility of these algorithms is demonstrated for application examples and some advantages and disadvantages of the underlying methods are pointed out.
Read moreAn Anisotropic Gaussian Filter for Noise Filtering of InSAR Interferogram
This paper addresses the problem of interferometric phase noise reduction in synthetic aperture radar interferometry. An anisotropic Gaussian filter is proposed in the paper. Different from those conventional isotropic filters, the filter can filter the phase noise according to the local fringe rates and the local noise levels. By using both, simulated and real interferometric phase images, the performance of the filter, in terms of fringes preservation and noise reduction, is demonstrated and compared with the mean filter and the median filter
Read more