Multiscale image segmentation using fractal and neural network

An efficient neural network based method for medical image segmentation

We develop a general framework to simultaneously exploit texture and shape characterization in multiscale image segmentation. By posing multiscale segmentation as a model selection problem, we invoke the powerful framework offered by minimum description length (MDL). This framework dictates that multiscale segmentation comprises multiscale texture characterization and multiscale shape coding. Analysis of current multiscale maximum a posteriori segmentation algorithms reveals that these algorithms implicitly use a shape coder with the aim to estimate the optimal MDL solution, but find only an approximate solution.

A fuzzy self-organizing map (SOM) network is proposed in this paper for visual motor control of a 7 degrees of freedom (DOF) robot manipulator. The inverse kinematic map from the image plane to joint angle space of a redundant manipulator is highly nonlinear and ill-posed in the sense that a typical end-effector position is associated with several joint angle vectors. In the proposed approach, the robot workspace in image plane is discretized into a number of fuzzy regions whose center locations and fuzzy membership values are determined using a Fuzzy C-Mean (FCM) clustering algorithm. SOM network then learns the inverse kinematics by on-line by associating a local linear map for each cluster. A novel learning algorithm has been proposed to make the robot manipulator to reach a target position. Any arbitrary level of accuracy can be achieved with a number of fine movements of the manipulator tip. These fine movements depend on the error between the target position and the current manipulator position. In particular, the fuzzy model is found to be better as compared to Kohonen self-organizing map (KSOM) based learning scheme proposed for visual motor control. Like existing KSOM learning schemes, the proposed scheme leads to a unique inverse kinematic solution even for a redundant manipulator. The proposed algorithms have been successfully implemented in real-time on a 7 DOF PowerCube robot manipulator, and results are found to concur with the theoretical findings.

ABSTRACTScale computation for multi-scale image segmentation is an important research area in geographic object-based image analysis (GEOBIA). For the highly spectral heterogeneity of high spatial resolution remotely sensed imagery (HSRRSI), and the changing sizes of geographic features and their spatially distributive patterns, it is difficult to build a global or local-scale calculation parameter model to effectively guide multi-scale segmentation parameters setting in large-scale regions. Usually, the segmentation parameters are used to measure the heterogeneous and homogenous adjacent pixels in spatial and spectral spaces simultaneously. It has been proved that the adaptive acquiring parameter of scale plays a key role in gaining precise segmentation results, and later it deeply influences the automatic recognition and post-processing of the physical image parcels (PIPs). However, in most cases, scale computation techniques still fail to guide segmentation to produce appropriate or repeatable results which should meet the practical production standard of GIS data based on GEOBIA. These techniques have not been summarized and classified and there is no review focusing on scale computation for HSRRSI multi-scale segmentation. We provide an overview of the state-of-the-art segmentation scale computation techniques which are mainly based on the spectral statistics and geometric characteristics, etc. Moreover, the pedigree of segmentation scale has been first time proposed, and the overall performance of each category is analysed. Especially, the methods of local variance, semivariance, and synthetic semivariance are presented. Then, the scale object selection (SOS) algorithm, spectral angle algorithm, and the RMAS (ratio of mean difference to neighbours (ABS) to standard deviation) are discussed at spectral domain. In addition, miscellaneous scale computation approaches are recognized as the important researching aspect. In order to clearly describe the scale computation on multi-scale image segmentation, we have proposed the new conceptions of semantic image object (SIO), PIP, particular scale of interest, symbiotic scale, etc. At last, the trends of scale computation for HSRRSI multi-scale segmentation also have been presented.

In recent years, the machine learning field has been inundated with a variety of deep learning methods. Different deep learning model types, including recurrent neural networks (RNNs), convolutional neural networks (CNNs), adversarial neural networks (ANNs), and autoencoders, are successfully tackling challenging computer vision problems including image detection and segmentation in an unconstrained environment. Although image segmentation has received a lot of interest, there have been several new deep learning methods discovered with regard to object detection and recognition. An academic review of deep learning image segmentation methods is presented in this article. In this study, the major goal is to offer a sensible comprehension of the basic approaches that have already made a substantial contribution to the domain of image segmentation throughout the years. The article describes the existing state of image segmentation, and goes on to make the argument that deep learning has revolutionized this field. Afterwards, segmentation algorithms have been scientifically classified and optimized, each with their own special contribution. With a variety of informative narratives, the reader may be able to understand the internal workings of these processes more quickly.

An investigation of local energy surface detection integrated with neural network techniques for image segmentation is presented, as applied in the feature extraction of chromosomes from image datasets obtained using an experimental confocal microscope. Use of the confocal microscope enables biologists to observe dividing cells (living or preserved) within a three-dimensional (3-D) volume, that can be visualised from multiple aspects, allowing for increased structural insight. The Nomarski differential interference contrast mode used for imaging translucent specimens, such as chromosomes, produces images not suitable for volume rendering. Segmentation of the chromosomes from this data is, thus, necessary. A neural network based on competitive learning, known as Kohonen's self-organizing feature map (SOFM) was used to perform segmentation, using a collection of statistics or features defining the image. Our past investigation showed that standard features such as the localized mean and variance of pixel intensities provided reasonable extraction of objects such as mitotic chromosomes, but surface detail was only moderately resolved. In this current work, a biologically inspired feature known as local energy is investigated as an alternative image statistic based on phase congruency in the image. This, along with different combinations of other image statistics, is applied in a SOFM, producing 3-D images exhibiting vast improvement in the level of detail and clearly isolating the chromosomes from the background. Index Terms-DIC, differential interference contrast, feature extraction, feature space, image segmentation, local energy, Morlet wavelet, phase congruency, self organizing feature map, SOFM.

Extending the Kohonen self-organizing map networks for clustering analysis

Building extraction algorithm based on multiscale segmentation using high resolution remote sensing images and LiDAR data is presented. Image objects are obtained by multiscale image segmentation. Following that, extraction is fulfilled using DSM and spectrum features of building objects. Optimized scale is selected with unsupervised method, and segmentation is optimized with multiscale method. The algorithm has a simple structure and low computation complexity. Results of experiment prove it is efficient.

<!--[if gte mso 10]> <mce:style><! /* Style Definitions */ table.MsoNormalTable {mso-style-name:"Norm&aacute;l t&aacute;bl&aacute;zat"; mso-tstyle-rowband-size:0; mso-tstyle-colband-size:0; mso-style-noshow:yes; mso-style-priority:99; mso-style-qformat:yes; mso-style-parent:""; mso-padding-alt:0cm 5.4pt 0cm 5.4pt; mso-para-margin:0cm; mso-para-margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:11.0pt; font-family:"Calibri","sans-serif"; mso-ascii-font-family:Calibri; mso-ascii-theme-font:minor-latin; mso-fareast-font-family:"Times New Roman"; mso-fareast-theme-font:minor-fareast; mso-hansi-font-family:Calibri; mso-hansi-theme-font:minor-latin; mso-bidi-font-family:"Times New Roman"; mso-bidi-theme-font:minor-bidi;} > <! [endif] ><p class="MsoNormal" style="text-align: justify; line-height: 200%;" _mce_style="text-align: justify; line-height: 200%;"><span style="font-size: 10pt; line-height: 200%; font-family: ";Arial";,";sans-serif";;" lang="EN-US">Traditional techniques of identification of a depositional body from core data are costly and sometimes difficult to extrapolate to uncored wells. However, application of Kohonen&rsquo;s Self Organized Map (SOM) approach may be regarded to be a potential method for pattern recognition problems. A combination of Indicator Kriging and SOM for log-porosity and sand content data coming from quantitative well-log interpretations is used for identifying the spatial pattern of some delta-plain sub-environments. The basic high-dimensional property fields are defined by 3D shapes of well known depositional facieses. Many parameters as log-porosity and sand content data can be used to determine geo-property as a lithological pattern using SOM. This step of method can discover spatial patterns as clusters in unstructured data set because SOM is based on clustering algorithm. However, this approach not necessarily makes sure, that the resulting disjunctive clusters can show any meaningful depositional geometry. So at last the final geometry is given using Indicator Kriging method, which uses threshold values derived from property values of clusters.</span><-->Traditional techniques to identify a depositional body from core data are costly and sometimes difficult to extrapolate to uncored wells. The application of Kohonen&rsquo;s Self Organized Map (SOM) approach may be useful for the interpretation of a depositional rock body through well-log data. SOM is based on a clustering algorithm and this method can be used to discover spatial patterns occurring as clusters in unstructured data sets. An example of the application of SOM is presented whereby clusters through SOM can indicate the contours of well-known depositional patterns such as sub-environments.

Estimating impervious surfaces from medium spatial resolution imagery using the self-organizing map and multi-layer perceptron neural networks

In this paper, we propose a similarity-based image retrieval considering artifacts by self-organizing map with refractoriness. In the self-organizing map with refractoriness, the plural neurons in the Map Layer corresponding to the input can fire sequentially because of the refractoriness. The proposed image retrieval system considering artifacts using the self-organizing map with refractoriness makes use of this property in order to retrieve plural similar images. In this image retrieval system, as the image feature, not only color information but also spectrum and keywords are employed. Moreover, the original image is divided into some areas by the K-means algorithm so that each divided area should not contain two or more objects. We carried out a series of computer experiments and confirmed that the effectiveness of the proposed system.

The traditional K-means clustering algorithm is difficult to determine the cluster number, which is sensitive to the initialization of the clustering center and easy to fall into local optimum. This paper proposes a clustering algorithm based on self-organizing mapping network and weight particle swarm optimization SOM&WPSO (Self-Organization Map and Weight Particle Swarm Optimization). Firstly, the algorithm takes the competitive learning mechanism of a self-organizing mapping network to divide the data samples into coarse clusters and obtain the clustering center. Then, the obtained clustering center is used as the initialization parameter of the weight particle swarm optimization algorithm. The particle position of the WPSO algorithm is determined by the traditional clustering center is improved to the sample weight, and the cluster center is the “food” of the particle group. Each particle moves toward the nearest cluster center. Each iteration optimizes the particle position and velocity and uses K-means and K-medoids recalculates cluster centers and cluster partitions until the end of the algorithm convergence iteration. After a lot of experimental analysis on the commonly used UCI data set, this paper not only solves the shortcomings of K-means clustering algorithm, the problem of dependence of the initial clustering center, and improves the accuracy of clustering, but also avoids falling into the local optimum. The algorithm has good global convergence.

To solve the complex background problems (e.g. Noise interference, object overlap, and different illumination) that affect the classification performance on plant leaf images, this paper proposes an instance segmentation and classification method for plant leaf images based on IFPN SNMS CFFI-Mask R-CNN (ISC-MRCNN) and ACPSOSVM-Dual Channels Convolutional Neural Network (APS-DCCNN). To obtain the foreground of plant leaf images, the lateral connection structure of the feature map pyramid in ISC-MRCNN fuses the feature maps of different depths, so that the network learns more detailed features. Then, the Soft Non-Maximum Suppression Algorithm is employed to improve the detection performance of overlapping objects. Next, the pooling method of integrating the continuous function can reduce the precision loss during the alignment of the mapping between the feature map and the original image. Finally, by constructing a mask filter layer, complex backgrounds are masked. To distinguish the similarity between plant leaf images, APS-DCCNN is used to classify the foreground images. In this process, the Support Vector Machine is used to replace softmax and then an Adaptive Chaotic Particle Swarm Algorithm is employed to optimize it. The experimental results show that compared with Mask R-CNN, the average precision of ISC-MRCNN has increased by 1.89% under different thresholds. The proposed method is suitable for the object detection and instance segmentation problems with complex background. Besides, compared with traditional CNN, the average precision of the classification results obtained by APS-DCCNN has improved by 1.59%. This has shown that the proposed method is suitable for the classification of plant leaves.

Horizontal and vertical search artificial bee colony for image segmentation of COVID-19 X-ray images

Evolutionary algorithms are used in many engineering applications for optimization of problems that are often difficult to solve using conventional methods. One such problem is image segmentation. This task is used for object (contour) extraction from images to create sensible representation of the image. There are many image segmentation and optimization methods. This work is focused on selected evolutionary optimization methods. Namely, particle swarm optimization, genetic algorithm, and differential evolution. Our image segmentation method is inspired in algorithm known as k-means. The optimization function from k-means algorithm is replaced by evolutionary technique. We compare original k-means algorithm with evolutionary approaches and we show that our evolutionary approaches easily outperform the classical approach.