Modified versions of SLIC algorithm for generating superpixels in hyperspectral images

This paper investigates the application of the Simple Linear Iterative Clustering (SLIC) algorithm for complex object image segmentation, on the example of images of human body injuries. The study solves the problem of the lack of quantitative evidence regarding SLIC's algorithm performance in high-precision area and boundary assessment of the lesion on a digital image of a human body with a wound injury on it. A comprehensive methodology is developed to evaluate SLIC's algorithm efficacy across various complex images and image resolutions. The research utilizes a combined dataset of 3696 wound images from the Foot Ulcer Segmentation Challenge (FUSeg) and WoundSeg datasets. Bayesian optimization is utilized to fine-tune SLIC algorithm hyperparameters, focusing on the number of segments and compactness. Results indicate that SLIC algorithm demonstrates consistent performance across different implementations, achieving Dice scores around 0.84 and Soft Boundary F1 scores around 0.55. The study reveals that the optimal number of segments for SLIC algorithm can be defined relative to the spatial dimensions of the input image, with maximal image dimension *2 being the most effective value. A thorough analysis of various segmentation metrics is conducted, including IoU, Dice Score, and Boundary F1 Score. The research introduces and employs the Soft Boundary F1 Score – modification of Boundary F1 Score, a novel metric designed to provide a more nuanced evaluation of boundary detection accuracy while offering a smoother optimization landscape. This metric proves particularly valuable in assessing the performance of SLIC algorithm in image with complex objects on them segmentation tasks. Importantly, this research presents an idealized SLIC-based segmentation approach, where superpixels are optimally combined using ground-truth masks to establish an upper bound of performance. This idealized SLIC algorithm segmentation is compared with a pre-trained on the FUSeg dataset UNet model, showcasing superior generalization capability across diverse wound types. On the WoundSeg dataset, the idealized SLIC algorithm approach achieved a Dice score of 0.84, significantly outperforming the UNet model (0.12 Dice score). As a result, this study provides valuable insights for improving complex objects segmentation methods and highlights the need for further research on developing effective methods for superpixel classification in real-world scenarios. The findings also highlight the potential of SLIC-based approaches in addressing the challenges of diverse data types and limited training data.

Detection of fusarium head blight in wheat under field conditions using a hyperspectral camera and machine learning

Simple Linear Iterative Clustering (SLIC) algorithm is increasingly applied to different kinds of image processing because of its excellent perceptually meaningful characteristics. In order to better meet the needs of medical image processing and provide technical reference for SLIC on the application of medical image segmentation, two indicators of boundary accuracy and superpixel uniformity are introduced with other indicators to systematically analyze the performance of SLIC algorithm, compared with Normalized cuts and Turbopixels algorithm. The extensive experimental results show that SLIC is faster and less sensitive to the image type and the setting superpixel number than other similar algorithms such as Turbopixels and Normalized cuts algorithms. And it also has a great benefit to the boundary recall, the robustness of fuzzy boundary, the setting superpixel size and the segmentation performance on medical image segmentation.

Deep learning (DL) has been shown to obtain superior results for classification tasks in the field of remote sensing hyperspectral imaging. Superpixel-based techniques can be applied to DL, significantly decreasing training and prediction times, but the results are usually far from satisfactory due to overfitting. Data augmentation techniques alleviate the problem by synthetically generating new samples from an existing dataset in order to improve the generalization capabilities of the classification model. In this paper we propose a novel data augmentation framework in the context of superpixel-based DL called dual-window superpixel (DWS). With DWS, data augmentation is performed over patches centered on the superpixels obtained by the application of simple linear iterative clustering (SLIC) superpixel segmentation. DWS is based on dividing the input patches extracted from the superpixels into two regions and independently applying transformations over them. As a result, four different data augmentation techniques are proposed that can be applied to a superpixel-based CNN classification scheme. An extensive comparison in terms of classification accuracy with other data augmentation techniques from the literature using two datasets is also shown. One of the datasets consists of small hyperspectral small scenes commonly found in the literature. The other consists of large multispectral vegetation scenes of river basins. The experimental results show that the proposed approach increases the overall classification accuracy for the selected datasets. In particular, two of the data augmentation techniques introduced, namely, dual-flip and dual-rotate, obtained the best results.

For better analyzing and adopting superpixel methods in image segmentation, an improved Simple Linear Iterative Clustering (SLIC) algorithm is put forward, which sustains that homogeneous regions show high consistence during clustering. Firstly, a primary iteration of SLIC approach is employed to generate uniform superpixels. Then an update strategy is introduced to determine whether to recluster the candidate region. In homogeneous regions, a cluster center often shows relatively small deviation of last position in spatial-color feature space when local iteration occurs, which can be regarded as redundant computation and be reduced. Experimental results show that the strategy brings a remarkable increased efficiency for traditional SLIC without significant affection on segmentation results.

The water body extraction technology based on superpixel segmentation in SAR images faces challenges such as insufficient precision in extracting fine water boundaries under speckle noise and complex scattering conditions. To address these issues, this paper proposes an enhanced fine water body extraction method based on superpixel segmentation for SAR images. In the superpixel segmentation phase, a simple linear iterative clustering (SLIC) superpixel segmentation algorithm based on eightdirection convolution (referred to as EDC-SLIC algorithm) is introduced. This algorithm constructs three pseudo-channels using eight-direction convolution to replace the three color channels of traditional color images and employs logarithmic difference measurement in the color distance calculation part of the SLIC algorithm, thereby adapting it to the segmentation requirements of SAR images. In the water body information extraction phase, a multi-feature weighted Otsu water body information extraction algorithm integrating superpixels (referred to as MFW-Otsu algorithm) is proposed. This algorithm integrates local mean and variance into a new feature image through weighting, enabling more accurate representation of texture changes in the image and enhancing the algorithm's ability to process complex image structures. The experimental results demonstrate that the EDC-SLIC algorithm and MFW-Otsu algorithm exhibit significant advantages in accuracy, robustness, and practicality. Furthermore, the integration of superpixels effectively improves the algorithm's adaptability to complex scenes, enhances detail processing capabilities, reduces misclassification phenomena, and improves the accuracy of water body information extraction.

With the high spectral resolution, hyperspectral image (HSI) can provide a wealth of information for image classification. Many classification methods utilize the training samples to classify the ground materials. However, the small sample problem is still urgent to be solved when considering the cost of labeling training samples. In order to solve this problem, this letter proposes a semisupervised classification method based on the simple linear iterative cluster (SLIC) segmentation for HSI. This method improves the SLIC method to better explore the spectral characteristic of HSI. It explores the learned superpixel map and initial classification map to select the pseudo-labeled samples (PLSs), which is expected to increase the effectiveness of PLSs. The final classification map can be obtained with the integrated labeled training samples and PLSs. Experiments were carried out on three HSIs, and it was founded that the proposed method generally shows a better classification performance than the other methods.

Superpixel algorithm aims to semantically group neighboring pixels into a coherent region. It could significantly boost the performance of the subsequent vision processing task such as image segmentation. Recently, the work simple linear iterative clustering (SLIC) [1] has drawn huge attention for its state-of-the-art segmentation performance and high computational efficiency. However, the performance of SLIC is dramatically degraded for noisy images. In this work, we propose three measures to improve the robustness of SLIC against noise: 1) a new pixel intensity distance measurement is designed by explicitly considering the within-cluster noise variance; 2) the spatial distance measurement is refined by exploiting the variation of pixel locations in a cluster; and 3) a noise-robust estimator is proposed to update the cluster centers by excluding the possible outliers caused by noise. Extensive experimental results on synthetic noisy images validate the effectiveness of those improvements. In addition, we apply the proposed noise-robust SLIC to superpixel-based noise level estimation task to demonstrate its practical usage.

Semi-supervised image segmentation in order to get a divided image from the tag portion. In this paper, a new semi-supervised image segmentation framework with global boundaries of probability (gPb) and simple linear iterative clustering (SLIC) is proposed. We use SLIC to perform image segmentation of super pixels, and we have constructed a graph, in which each vertex is a superpixel. Then we utilize gPb to define the edge weights for the graph. Semi-supervised learning based image (GSSL) method, and the use of labeled samples to calculate anchor anchor category, the category may be further determined by the anchor point of the sample. The results of the experiments certify the robustness and effectiveness of the method proposed in this paper.

Parameter-free image segmentation with SLIC

Low contrast images and blurriness pose challenge in the over‐segmentation of image, which increases model complexities. In this work, a novel hybrid dermoscopic skin‐lesion segmentation method, namely SLICACO, is proposed incorporating the simple linear iterative clustering (SLIC) and ant colony optimization (ACO) algorithms. The working of proposed method is multifold. First, over‐segmentation of preprocessed image is generated using SLIC super‐pixel technique. Second, clusters of super‐pixels generated by SLIC are used by ACO with the pixels of similar intensity for edge detection and seek for the optimum pathway in a strained zone. Third, lesion area is segmented using the Convex Hull and Thresholding. Fourth, Erosion Filtering is used to obtain the final segmented image. The performance of SLICACO is assessed on five benchmark dermatoscopic datasets and compared with deep learning models to test its generalizing behavior. Promising results are obtained on the PH2 archive data set with an accuracy of 95.9%.

Change detection is one of the fundamental applications of synthetic aperture radar (SAR) images. However, speckle noise presented in SAR images has a negative effect on change detection, leading to frequent false alarms in the mapping products. In this research, a novel two-phase object-based deep learning approach is proposed for multi-temporal SAR image change detection. Compared with traditional methods, the proposed approach brings two main innovations. One is to classify all pixels into three categories rather than two categories: unchanged pixels, changed pixels caused by strong speckle (false changes), and changed pixels formed by real terrain variation (real changes). The other is to group neighbouring pixels into superpixel objects such as to exploit local spatial context. Two phases are designed in the methodology: (1) Generate objects based on the simple linear iterative clustering (SLIC) algorithm, and discriminate these objects into changed and unchanged classes using fuzzy c-means (FCM) clustering and a deep PCANet. The prediction of this Phase is the set of changed and unchanged superpixels. (2) Deep learning on the pixel sets over the changed superpixels only, obtained in the first phase, to discriminate real changes from false changes. SLIC is employed again to achieve new superpixels in the second phase. Low rank and sparse decomposition are applied to these new superpixels to suppress speckle noise significantly. A further clustering step is applied to these new superpixels via FCM. A new PCANet is then trained to classify two kinds of changed superpixels to achieve the final change maps. Numerical experiments demonstrate that, compared with benchmark methods, the proposed approach can distinguish real changes from false changes effectively with significantly reduced false alarm rates, and achieve up to 99.71% change detection accuracy using multi-temporal SAR imagery.

To segment the tumor region precisely is a prerequisite for ultrasound navigation and treatment. In this paper, a normalized cut method to segment tumor ultrasound image is proposed by means of simple linear iterative clustering for pre-segmentation procedure. The first step, we use simple linear iterative clustering algorithm to divide the image into a number of homogeneous over-segmented regions. Then, these regions are regarded as nodes, and a similarity matrix is constructed by comparing the histograms of each two regions. Finally, we apply the Ncut method to merging the over-segmented regions, then the image segmentation process is completed. The results show that the proposed segmentation scheme handles the strong speckle noise, low contrast, and weak edges well in ultrasound image. Our method has high segmentation precision and computation efficiency than the pixel-based Ncut method.

To solve the problems of image threshold segmentation based on weak continuous constraint theory, the running time is long, and the two parameters need to be selected manually, and therefore a fast single-parameter energy function thresholding for image segmentation based on region information (FSEFTISRI) is proposed in this paper. The proposed FSEFTISRI algorithm uses simple linear iterative clustering (SLIC) technology to pre-block the image, extract the image super-pixels, and then map the image super-pixels to the interval type-2 fuzzy set (IT2FS), so as to construct the single-parameter energy function to search the optimal threshold, and adaptively select the penalty parameters in the energy function through the class uncertainty theory. On a non-destructive testing (NDT) database and Berkeley segmentation datasets and benchmarks (BSDS), the proposed FSEFTISRI is compared with five related algorithms. The average misclassification error (ME) of the proposed FSEFTISRI algorithm on NDT and BSDS are 0.0466 and 0.0039, respectively. The results show that the proposed FSEFTISRI has acquired more satisfactory results in visual effect and evaluation index, and the running time of the proposed FSEFTISRI algorithm is shorter, which shows the effectiveness of the proposed FSEFTISRI.

Over-segmentation, or superpixel segmentation is widely applied in various image processing tasks such as image classification and region-based change detection. In polarimetric synthetic aperture radar (PolSAR) image processing, the complex Wishart distribution is commonly used in the modeling of homogeneous regions. In this paper, we introduce a segmentation method for multi-temporal PolSAR images based on the simple linear iterative clustering (SLIC) framework. We apply the Wishart distribution-based distance and modify the combination form for the SLIC distance measure such that the SLIC method can be adapted to the statistical characteristics of PolSAR imagery. Compared with existing PolSAR image superpixel methods, the proposed method has better time cost efficiency while maintaining the performance on segmentation results. Moreover, the proposed method is capable of jointly segmenting two or more multi-temporal PolSAR images, which is the basis for some further earth observation applications such as change detection and region-based data fusion tasks.