Texture-based segmentation of satellite weather imagery

Segmentation is a low-level processing aimed at the partition of an image in disjoint regions, each one homogeneous with respect to some properties like intensity, texture, shape, etc. Such a task is needed in many high-level processing and applications in such diverse fields as remote-sensing, medical imaging, video coding, and industrial automation, just to name a few. In this work of thesis, we first deal with the problem of color based image segmentation, that is based on some form of homogeneity in the color/spectral properties of the image, and then move to the more complex task of texture based segmentation, where the aim is to recognize complex structures in the image which are typically non homogeneous in terms of spectral properties. Concerning color based segmentation, we focus on a specific class of Markov Random Field (MRF) probability models, namely the Tree-Structured Markov Random Fields (TS-MRF), recently proposed to provide a hierarchical multiscale description of images. Based on such a model, the unsupervised image segmentation is carried out by means of a sequence of nested class splits, where each class is modeled as a local binary MRF. As a first contribution, we first extend the model to generic tree structures removing the unnecessary binary constraint, and then devise a new TS-MRF unsupervised segmentation technique which improves upon the original algorithm by selecting a better tree structure and eliminating spurious classes. Such results are obtained by using the Mean-Shift procedure to estimate the number of pdf modes at each node, and to obtain a more reliable initial clustering for subsequent MRF optimization. To this end, we devise a new reliable and fast clustering algorithm based on the Mean-Shift technique, which makes use of a variable-bandwidth strategy based on the k-Nearest Neighbors (k-NN) technique, and is implemented with a speed-up strategy that cuts significantly the computational complexity. Experimental results on synthetic data and real life images from the remote sensing domain prove the potential of the proposed method. Turning to texture based segmentation, we present a novel multiscale texture model, and a related algorithm for the unsupervised segmentation of color images. Elementary textures are characterized by their spatial interactions with neighboring regions along selected directions. Such interactions are modeled in turn by means of a set of Markov chains, one for each direction, whose parameters are collected in a feature vector that synthetically describes the texture. Based on the feature vectors, the texture are then recursively merged, giving rise to larger and more complex textures, which appear at different scales of observation: accordingly, the model is named Hierarchical Multiple Markov Chain (H-MMC). The Texture Fragmentation and Reconstruction (TFR) algorithm, addresses the unsupervised segmentation problem based on the H-MMC model. The ``fragmentation'' step allows one to find the elementary textures of the model, while the ``reconstruction'' step defines the hierarchical image segmentation based on a probabilistic measure (texture score) which takes into account both region scale and inter-region interactions. The performance of the proposed method was assessed through the Prague segmentation benchmark, based on mosaics of real natural textures, and also tested on real-world natural images from the Berkeley dataset. Finally, an application of the TFR algorithm for the unsupervised segmentation of multiresolution remotely sensed images is proposed, based on the significant presence of textural content in last generation high-resolution satellite images. The obtained results further assess the potential of the proposed method for such real life applications.

We propose a novel approach to investigate and implement unsupervised image content understanding and segmentation of color industrial images like medical imaging, forensic imaging, security and surveillance imaging, biotechnical imaging, biometrics, mineral and mining imaging, material science imaging, and many more. In this particular work, our focus will be on medical images only. The aim is to develop a computer aided diagnosis (CAD) system based on a newly developed Multidimensional Spatially Variant Finite Mixture Model (MSVFMM) using Markov Random Fields (MRF) Model. Unsupervised means automatic discovery of classes or clusters in images rather than generating the class or cluster descriptions from training image sets. The aim of this work is to produce precise segmentation of color medical images on the basis of subtle color and texture variation. Finer segmentation of images has tremendous potential in medical imaging where subtle information related to color and texture is required to analyze the image accurately. In this particular work, we have used CIE-Luv and Daubechies wavelet transforms as color and texture descriptors respectively. Using the combined effect of a CIE-Luv color model and Daubechies transforms, we can segment color medical images precisely in a meaningful manner. The evaluation of the results is done through comparison of the segmentation quality with another similar alternative approach and it is found that the proposed approach is capable of producing more faithful segmentation.

The application of a Markov random field (MRF) state model in an expectation-maximization (EM)-based approach to unsupervised image segmentation is investigated. In the calculation of the marginal distribution of the state field, it is shown that the use of the expected state values for interacting pixel sites in the computation of the MRF energy function may be interpreted as a mean-field approximation. The implications of calculating a self-consistent expectation of the state field are considered. EM convergence criteria are considered, and a criterion based upon divergence is proposed. Experimental results based on synthetic data illustrate the performance advantage of the mean-field approximation and the computational advantage of using self-consistent expectations. >

Unsupervised segmentation of noisy and textured images using Markov random fields

The past 20 years has seen a progressive evolution of computer vision algorithms for unsupervised 2D image segmentation. While earlier efforts relied on Markov random fields and efficient optimization (graph cuts, etc.), the next wave of methods beginning in the early part of this century were, in the main, stovepiped. Of these 2D segmentation efforts, one of the most popular and, indeed, one that comes close to being a state of the art method is the ultrametric contour map (UCM). The pipelined methodology consists of (i) computing local, oriented responses, (ii) graph creation, (iii) eigenvector computation (globalization), (iv) integration of local and global information, (v) contour extraction, and (vi) superpixel hierarchy construction. UCM performs well on a range of 2D tasks. Consequently, it is somewhat surprising that no 3D version of UCM exists at the present time. To address that lack, we present a novel 3D supervoxel segmentation method, dubbed 3D UCM, which closely follows its 2D counterpart while adding 3D relevant features. The methodology, driven by supervoxel extraction, combines local and global gradient-based features together to first produce a low-level supervoxel graph. Subsequently, an agglomerative approach is used to group supervoxel structures into a segmentation hierarchy with explicitly imposed containment of lower-level supervoxels in higher-level supervoxels. Comparisons are conducted against state of the art 3D segmentation algorithms. The considered applications are 3D spatial and 2D spatiotemporal segmentation scenarios. For the latter comparisons, we present results of 3D UCM with and without optical flow video pre-processing. As expected, when motion correction beyond a certain range is required, we demonstrate that 3D UCM in conjunction with optical flow is a very useful addition to the pantheon of video segmentation methods.

Image segmentation is the process of partitioning a digital image into a set of homogeneous regions (according to some homogeneity criterion) to facilitate a subsequent higher-level analysis. In this context, the present paper proposes an unsupervised and graph-based method of image segmentation, which is driven by an application goal, namely, the generation of image segments associated with a user-defined and application-specific goal. A graph, together with a random grid of source elements, is defined on top of the input image. From each source satisfying a goal-driven predicate, called seed, a propagation algorithm assigns a cost to each pixel on the basis of similarity and topological connectivity, measuring the degree of association with the reference seed. Then, the set of most significant regions is automatically extracted and used to estimate a statistical model for each region. Finally, the segmentation problem is expressed in a Bayesian framework in terms of probabilistic Markov random field (MRF) graphical modeling. An ad hoc energy function is defined based on parametric models, a seed-specific spatial feature, a background-specific potential, and local-contextual information. This energy function is minimized through graph cuts and, more specifically, the alpha-beta swap algorithm, yielding the final goal-driven segmentation based on the maximum a posteriori (MAP) decision rule. The proposed method does not require deep a priori knowledge (e.g., labelled datasets), as it only requires the choice of a goal-driven predicate and a suited parametric model for the data. In the experimental validation with both magnetic resonance (MR) and synthetic aperture radar (SAR) images, the method demonstrates robustness, versatility, and applicability to different domains, thus allowing for further analyses guided by the generated products.

Hidden Markov fields have been extensively applied in the field of synthetic aperture radar (SAR) image processing, mainly for segmentation and change detection. In such models, the hidden process of interest $X$ is assumed to be a Markov field that is to be searched from an observable process $Y$ . The possibility of such estimation lies, however, on several assumptions that turn out to be unsuitable for many natural systems. These models have then been extended in many directions, leading to triplet Markov fields among other extensions. A link has then been established between these models and the theory of evidence, opening new possibilities of uncertainty modeling and information fusion. The aim of this letter is to further generalize the hidden evidential Markov field (EMF) to consider more general forms of noise with application to unsupervised segmentation of SAR images. For parameters estimation, we use iterative conditional estimation, whereas maximization is performed through iterative conditional mode. The performance of the proposed model is assessed against the original EMF on real SAR images.

The demand for accurate and reliable unsupervised image segmentation methods is high. Regardless of whether we are faced with a problem for which we do not have a usable training dataset, or whether it is not possible to obtain one, we still need to be able to extract the desired information from images. In such cases, we are usually gently pushed towards the best possible clustering method, as it is often more robust than simple traditional image processing methods. We investigate the usefulness of combining two clustering methods for unsupervised image segmentation. We use the mixture models to extract the color and spatial image features based on the obtained output segments. Then we construct a similarity matrix (adjacency matrix) based on these features to perform spectral clustering. In between, we propose a label noise correction using Markov random fields. We investigate the usefulness of our method on many hand-crafted images of different objects with different shapes, colorization, and noise. Compared to other clustering methods, our proposal performs better, with 10% higher accuracy. Compared to state-of-the-art supervised image segmentation methods based on deep convolutional neural networks, our proposal proves to be competitive.

The traditional multi-resolution Markov random field (MRMRF) model uses two-component Markov random field model on each resolution, and requires training data to estimate the necessary model parameters, which is unsuitable for unsupervised image segmentation. Under this circumstance, a new multi-resolution Markov random field model with variable potential for unsupervised texture image segmentation is presented. The new model solves this problem by introducing a variable potential function for multi-level logistic distribution (MLL) model on each scale. Using this method, the new model can automatically estimate model parameters and produce accurate unsupervised segmentation results. The results obtained on synthetic texture images and remote sensing images demonstrate that a better segmentation is achieved by our model than the traditional MRMRF model.

A new image segmentation algorithm based on Markov random field (MRF) and ant colony system (ACS) is presented in this paper. Information positive feedback and heuristic search, the characters of ACS, were applied for the image segmentations with MRF model. The maximum a posterior (MAP) global best solution of segmentations will be got though MRF, which describes image data relations by local correlations instead of global image possibility distributions. Compared with the simulated annealing (AS), ACS needs less time to search the global best solution. In this paper we proposed a segmentation algorithm combined MRF with ACS, which not only applied ACS as optimization algorithm but also introduced the neighborhood pheromone interaction rules into ACS under MRF model. Especially the pheromone interaction update provided remunerative information to ants in a neighborhood instead of an ant, which could accelerate the optimizing velocity and restrain the relative blur noise. The followed image segmentations experiments proved that this novel algorithm could reach a satisfied result among the noise restraint, edges preservation and computation complexity.

The present paper is concerned with the study of parallel approaches for the relaxation algorithms associated to Markov Random Fields (MRF) models in image analysis, [2]. MRF-based relaxation algorithms are known to be intrinsically parallel and massive parallelizations by updating at once independent variables of the field have been early described, [4]. We present here a different approach based on relaxation algorithms running in parallel at different and interacting periodically. The proposed approach is based on parallel Markov chains which have been studied by Aarts et al., [l], and Graffigne, [3], for global optimization using simulated annealing. In our method, parallel Markov chains are coupled with a new multiscale exploration of the configuration space for MRF. This multiscale exploration can be implemented efficiently by considering a sequence of multiresolution MRF models whose parameters and neighborhood structures are obtained from the original MRF model. The designed algorithm is suited for MIMD computers and can be outlined as follows. First MRF models at different scales are computed from the original MRF model. The relaxations at different scales are stochastic and cooperative : every p iterations - one iteration corresponding to a full sweep on the image - a processor attempts to transfer local estimates to the processor controlling the next finer scale. With the low resolution levels of the hierarchy are associated high temperatures in the stochastic relaxation, [3]. A high temperature allows to escape from local minima of the energy function. With the intermediate resolution levels are associated lower temperatures. At these levels, the relaxation process becomes more sensitive to local minima and visits the large or medium size valleys of the energy landscape. At the finest resolution level deterministic relaxation is adopted : the estimation is ultimately refined at that level. The proposed parallelization approach is compared to sequential deterministic and stochastic relaxation in the context of optical flow estimation. The multiscale algorithm exhibits fast convergence properties, comparable to multigrid deterministic relaxation, and the obtained estimates are close to the near optimal solutions obtained by time consuming sequential stochastic methods.

In this paper, an unsupervised segmentation method using clustering is presented for color images. We propose to use a neural network based approach to automatic feature selection to achieve adaptive segmentation of color images. With a self-organizing feature map (SOFM), multiple color features can be analyzed, and the useful feature sequence (feature vector) can then be determined. The encoded feature vector is used in the final segmentation using fuzzy clustering. The proposed method has been applied in segmenting different types of color images, and the experimental results show that it outperforms the classical clustering method. Our study shows that the feature encoding approach offers great promise in automating and optimizing the segmentation of color images.

Image segmentation method combined with Markov random field (MRF) model and regional growth image in this paper is proposed to achieve the accuracy of sonar image segmentation. First of all, the characteristics of field and the label field of sonar image is established through the MRF model; secondly, the further image segmentation is processed by region growing based on the initial image segmentation by ICM algorithm, and this reduced segmentation plaques caused by the MRF method on image segmentation. Finally, experimental results show that the method in this paper can obtain the image segmentation effectively.

This paper deals with the statistical segmentation of multisensor images. In a Bayesian context, the interest of using hidden Markov random fields, which allows one to take contextual information into account, has been well known for about 20 years. In other situations, the Bayesian framework is insufficient and one must make use of the theory of evidence. The aim of the authors' work is to propose evidential models that can take into account contextual information via Markovian fields. They define a general evidential Markovian model and show that it is usable in practice. Different simulation results presented show the interest of evidential Markovian field model-based segmentation algorithms. Furthermore, an original variant of generalized mixture estimation, making possible the unsupervised evidential fusion in a Markovian context, is described. It is applied to the unsupervised segmentation of real radar and SPOT images showing the relevance of the proposed models and corresponding segmentation methods in real situations.

A parallel image segmentation algorithm using relaxation with varying neighborhoods and its mapping to array processors