Ensuring Fairness in Spectral Clustering via Disparate Impact-Based Graph Construction

Simulated annealing spectral clustering algorithm for image segmentation

Online image search result grouping with MapReduce-based image clustering and graph construction for large-scale photos

Supervised neighborhood graph construction for semi-supervised classification

The spectral clustering algorithm's space complexity is O(n <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> ), while time complexity is O(n <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> ). When dealing with large amounts of data, the memory will overflow and run-time is too long. For the general problem of spectral clustering, if the clustering data of sub-problem between the original problem has the same probability distribution, it can be applied to divide and conquer strategy for the problem of spectral clustering, by the spectral clustering results of sub-problems to get the spectral clustering results of original problem. To spectral clustering image segmentation as a research object, we will discuss the divide and conquer strategy for spectral clustering in this paper. Experiments show that the application of divide and conquer method for spectral clustering image segmentation, we can get a perfect performance in image segmentation.

Research on the fairness of spectral clustering has gradually increased attention. Normally, existing methods of fair spectral clustering add a fairness constraint to the original objective function so that fairness is guaranteed. However, similar to the solver of traditional spectral clustering, that of fairness spectral clustering has to relax a discrete value condition into an arbitrary one, which leads to the deterioration of both fairness and clustering quality. Moreover, the eigen-problem is inevitable in the solver, which takes O(n3) time complexity and is not available for large-scale data. In this paper, we propose a fair spectral clustering algorithm by employing the coordinate descent method to find the solution. As the relaxation of the discreteness condition is discarded, the fairness is improved. Furthermore, we refine the process of coordinate descent by avoiding redundant calculations, and as a result, the time complexity is reduced from O(n3) to O(n2). Additionally, the importance of clustering quality and fairness is symmetric; hence, we achieve a trade-off between them by adjusting the parameters. The experimental findings, obtained from both real-world and synthetic datasets, clearly illustrate that our proposal delivers superior fairness and clustering quality with the best BAL compared to other fair clustering methods. In addition, our method is more efficient than existing fair spectral clustering algorithms.

Spectral Clustering (SC) is an effective clustering method for its excellent performance in partitioning non-linearly distributed data. On the other hand, Ensemble Clustering (EC), a different clustering technology, can promote cluster quality by ensembling the results of base clusterings. In this work, we concentrate on an EC framework that utilizes SC as the base method. Nevertheless, SC suffers from scalability due to its high computational complexity in constructing the Laplacian graph and computing the corresponding eigendecomposition. In the past decades, many efforts have been made to it. However, SC suffers from the scalability issue in processing extensive data, especially in web-scale scenarios. Additionally, EC requires multiple clustering results as the ensemble bases, which further aggravates resource consumption. To address this issue, LiteWSEC, a simple yet efficient Lightweight Framework for Web-scale Spectral Ensemble Clustering, is proposed to cluster web-scale data with limited resource requirements. It adopts the Web-scale Spectral Clustering (WSC) as the base method, which has minimal space overhead without computing overall embedding explicitly. LiteWSEC is highly flexible in the memory requirement, which is adaptive to the available resource. It can partition web-scale data (e.g., <inline-formula><tex-math notation="LaTeX">$n $</tex-math></inline-formula> = 8,000 k) in an resource-limited host (e.g., memory is restricted to 1 GB). Experiments on real-world, large-scale, and web-scale datasets demonstrate both the efficiency and effectiveness of LiteWSEC over state-of-the-art SC and EC methods.

SummaryCluster ensemble combines multiple base clustering results in a suitable way to improve the accuracy of the clustering result. In the conventional cluster ensemble frameworks, pairwise constraints and constraint projections have not been used together, and spectral clustering algorithm is rarely adopted to serve as the consensus function. In this paper, we design a constraint projections for semi‐supervised spectral clustering ensemble (CPSSSCE) model. It takes advantages of spectral clustering algorithm and executes semi‐supervised learning twice. Compared to traditional cluster ensemble approaches, CPSSSCE is characterized by several properties. First, the original data are transformed to lower‐dimensional representations by constraint projection before base clustering. Second, a similarity matrix is constructed using the base clustering results and modified using pairwise constraints. Third, the spectral clustering algorithm is applied to process the similarity matrix to obtain a consensus cluster result. Extensive experiments on standard University of California Irvine Machine Learning Repository (UCI) and Microsoft datasets demonstrated that the CPSSSCE is superior to other cluster ensemble algorithms including a semi‐supervised spectral clustering ensemble.

For the spectral clustering algorithm in the large-scale samples, there are bottlenecks in the storage space and computing time, and the paper analyzes the current common solutions, namely based on the sparse t-nearest neighbor spectral clustering. In order to improve the accuracy of the spectral clustering algorithms, the Euclidean distance based on the attribute weight of information entropy is proposed to calculate the similarity between the samples. First, calculate the weight of each attribute of the sample and then calculate the similarity between the samples. The degree matrix is applied to the spectral clustering of sparse t-nearest neighbors in the last number of numbers. The experimental results show that the clustering accuracy of the method on some data sets is higher than that of the original spectral clustering algorithm.

Adaptive graph construction using data self-representativeness for pattern classification

A fast spectral clustering technique using MST based proximity graph for diversified datasets

Spectral clustering has exhibited a superior performance in analyzing the cluster structure of network. However, the exponentially computational complexity limits its application in analyzing large-scale social networks. To tackle this problem, many low-rank matrix approximating algorithms are proposed, of which the NystrÖm method is an approach with proved lower approximate errors. Currently, most existing sampling techniques for NystrÖm method are designed on affinity matrices, which are time-consuming to compute by some similarity metrics. Moreover, the social networks are often built on link relations, in which there is no information to construct an affinity matrix for the approximate computing of NystrÖm method for spectral clustering except for the degrees of nodes. This paper proposes a spectral clustering algorithm for large-scale social networks via a pre-coarsening sampling based NystrÖm method. By virtue of a novel triangle-based coarsening policy, the proposed algorithm first shrinks the social network into a smaller weighted network, and then does an efficient sampling for NystrÖm method to approximate the eigen-decomposition of matrix of spectral clustering. Experimental results on real large-scale social networks demonstrate that the proposed algorithm outperforms the state-of-the-art spectral clustering algorithms, which are realized by the existing sampling techniques based NystrÖm methods.

Recently, a large amount of work has been devoted to the study of spectral clustering—a simple yet powerful method for finding structure in a data set using spectral properties of an associated pairwise similarity matrix. Most of the existing spectral clustering algorithms estimate only one cluster number or estimate non-unique cluster numbers based on eigengap criterion. However, the number of clusters not always exists one, and eigengap criterion lacks theoretical justification. In this paper, we propose non-unique cluster numbers determination methods based on stability in spectral clustering (NCNDBS). We first utilize the multiway normalized cut spectral clustering algorithm to cluster data set for a candidate cluster number \(k\). Then the ratio value of the multiway normalized cut criterion of the obtained clusters and the sum of the leading eigenvalues (descending sort) of the stochastic transition matrix is chosen as a standard to decide whether the \(k\) is a reasonable cluster number. At last, by varying the scaling parameter in the Gaussian function, we judge whether the reasonable cluster number \(k\) is also a stability one. By three stages, we can determine non-unique cluster numbers of a data set. The Lumpability theorem concluded by Meil\(\breve{a}\) and Xu provides a theoretical base for our methods. NCNDBS can estimate non-unique cluster numbers of the data set successfully by illustrative experiments.

Spectral clustering has become a typical and efficient clustering method used in a variety of applications. The critical step of spectral clustering is the similarity measurement, which largely determines the performance of the spectral clustering method. In this paper, we propose a novel spectral clustering algorithm based on the local similarity measure of shared neighbors. This similarity measurement exploits the local density information between data points based on the weight of the shared neighbors in a directed k $$ k $$ -nearest neighbor graph with only one parameter k $$ k $$ , that is, the number of nearest neighbors. Numerical experiments on synthetic and real-world datasets demonstrate that our proposed algorithm outperforms other existing spectral clustering algorithms in terms of the clustering performance measured via the normalized mutual information, clustering accuracy, and F $$ F $$ -measure. As an example, the proposed method can provide an improvement of 15.82% in the clustering performance for the Soybean dataset.

Fuzzy spectral clustering with robust spatial information for image segmentation

The similarity between words is used for word clustering. In spectral clustering algorithms, the information contained in the eigenvectors of an affinity matrix is used to detect the similarity. Compared with traditional clustering methods, spectral clustering performs much better for clustering the words especially in multidimensional vector spaces. the spectral clustering is implemented by Visual C++ and Matlab in the paper, which is applied to cluster small scale segmented Chinese corpus and large scale non-segmented Chinese corpus. good experimental results are observed and result analysis are given for spectral clustering.