A New Nonparametric Pairwise Clustering Algorithm Based on Iterative Estimation of Distance Profiles

The purpose of data clustering algorithm is to form clusters (groups) of data points such that there is high intra-cluster and low inter-cluster similarity. There are different types of clustering methods such as hierarchical, partitioning, grid and density based. Hierarchical clustering is a method of cluster analysis which seeks to build a hierarchy of clusters. A hierarchical clustering method can be thought of as a set of ordinary (flat) clustering methods organized in a tree structure. These methods construct the clusters by recursively partitioning the objects in either a top-down or bottom-up fashion. In this paper we present a new hierarchical clustering algorithm using Euclidean distance. To validate this method we have performed some experiments with low dimensional artificial datasets and high dimensional fMRI dataset. Finally the result of our method is compared to some of existing clustering methods.

Application of hierarchical clustering, singularity mapping, and Kohonen neural network to identify Ag-Au-Pb-Zn polymetallic mineralization associated geochemical anomaly in Pangxidong district

A novel travel-time based similarity measure for hierarchical clustering

Photovoltaic is attracting attention as one of the renewable energy sources that replace existing fossil fuel-based power generation. Photovoltaic power generation data clustering is becoming increasingly popular because it allows us to identify PV systems without extensive analysis and simulation. Generally, clustering method of PV power data analyzes only the meaning of each cluster, so it is difficult to grasp the similarity between clusters. In this paper, clustering of PV power data through hierarchical clustering algorithm is performed to calculate the relationship between clusters. The hierarchical clustering method was used to analyze the similarity of PV power data between clusters. As a result, PV power data were classified into seasonal clusters and defective clusters.

Community welfare is one of the important points for a region and is also the essence of national development. The welfare of the people in Indonesia is fairly unequal, especially in East Java. To be able to map an area to the welfare of its people in East Java, one way that can be used is to use clustering. The hierarchical clustering method is one of the clustering methods for grouping data. In hierarchical clustering, single linkage, complete linkage, and average linkage methods are suitable methods for grouping data, which will compare the best method to use. The results of the calculation show that the average linkage method with three clusters is the best calculation with a silhouette index value of 0.6054, with the 1st cluster there are 23 regions, namely the city/district with the highest community welfare, the 2nd cluster there are 11 regions, namely cities/districts with moderate social welfare, and in the third cluster there are 4 regions, namely cities/districts with the lowest community welfare.

Clustering has been used in literature to enhance classification accuracy. But most partitional clustering methods need the number of clusters as input and also they are sensitive to initialization. Although hierarchical clustering methods may be more effective in finding clustering structure of the dataset than partitional methods but hierarchical clustering methods give tree structure known as dendrogram which is a sequence of clustering solutions. Hence hierarchical clustering algorithms are not generally applied in the preprocessing step to classification methods. This problem can be solved by cutting the dendrogram to get single clustering solution. In this paper we propose a framework for classification which uses Optimal Clustering Genetic Algorithm (OCGA) to obtain optimal level of cutting the dendrogram. A single clustering solution is obtained by cutting the dendrogram at optimal level. The clusters obtained are used to enhance classification accuracy of the classification methods. The proposed classification methods have been applied for the diagnosis of diabetes disease.

Supplementary Material for the manuscript "Drivers of carbon dioxide emissions: An empirical investigation using hierarchical and non- hierarchical clustering methods"

Hierarchical clustering, a traditional clustering method, has been getting attention again. Among several reasons, a credit goes to a recent paper by Dasgupta in 2016 that proposed a cost function that quantitatively evaluates hierarchical clustering trees. An important question is how to combine this recent advance with existing successful clustering methods. In this paper, we propose a hierarchical clustering method to minimize the cost function of clustering tree by incorporating existing clustering techniques. First, we developed an ensemble tree-search method that finds an integrated tree with reduced cost by integrating multiple existing hierarchical clustering methods. Second, to operate on large and arbitrary shape data, we designed an efficient hierarchical clustering framework, called integrating divisive and ensemble-agglomerate (IDEA) by combining it with advanced clustering techniques such as nearest neighbor graph construction, divisive-agglomerate hybridization, and dynamic cut tree. The IDEA clustering method showed better performance in minimizing Dasgupta's cost and improving accuracy (adjusted rand index) over existing cost-minimization-based, and density-based hierarchical clustering methods in experiments using arbitrary shape datasets and complex biology-domain datasets.

In Indonesia, Dengue Fever (DF) is a contagious disease that is a significant issue in public health. The Kediri Regency in East Java, as reported by the Ministry of Health in 2019, had the highest number of DF cases. If not addressed promptly, DF can lead to outbreaks, creating a health emergency. The lack of a thorough investigation into the diversity of risk within a spatial and temporal region exacerbates this issue. Therefore, spatial-temporal analysis is crucial in developing a warning system to prevent and control DF. This paper proposes a method that combines the Euclidean Distance calculation with the Hierarchical Clustering method. We collected data from the Kediri Regency health department and conducted pre-processing and classification processes, considering the number of DF victims, death rate, population, rainfall, and public facilities. The hierarchical clustering algorithm was used to categorize the 344 village analyses into low, medium, and high vulnerability categories. This method allows for a comparison of yearly single, average, complete, and centroid linkage in DF vulnerability levels. We also employed spatial-temporal visualization based on cellular applications to create a clear picture of areas vulnerable to DF. The experimental results in clustering showed a satisfactory level of matching, with variant values calculated using the hierarchical clustering method. The variants for single linkages were 0.113; for average linkages, they were 0.120; for complete linkages, they were 0.178; and for centroid linkages, they were 0.106. The grouping validation results indicated that the centroid linkage method produced the best variant level. We suggest further enhancing the methods with better process steps using other pre-processing methods to improve the validation quality.

Several parallel algorithms and parallel architectures have been developed for partitional clustering. Hierarchical clustering algorithms are also widely used in exploratory pattern analysis and unsupervised learning. The author proposes parallel algorithms on single-instruction/multiple-data (SIMD) machines for hierarchical clustering, which require intensive computation and large memory storage. The machine model includes a parallel memory system and an alignment network, to facilitate parallel access of both pattern matrix and proximity matrix. Since clustering algorithms tend to generate clusters even when applied to random data, clustering-tendency and cluster-validity studies are usually performed. The author proposes a parallel algorithm to compute one type of cluster validity measure global fit of hierarchy for quantitative data. For a problem with N patterns, considering validity study as well as clustering, the number of memory accesses is reduced from O(/sup 3/) on a sequential machine to O(N/sup 2/) on a SIMD machine with N processing elements (PEs). More general algorithms for different numbers of PEs are also given. >

This work aims to expand the knowledge of the area of data analysis through persistence homology and representations of directed graphs. To be specific, we looked for how we can analyze homology cluster groups using agglomerative Hierarchical Clustering algorithms and methods. Additionally, the Wine data, which is offered in R studio, was analyzed using various cluster algorithms such as Hierarchical Clustering, K-Means Clustering, and PAM Clustering. The goal of the analysis was to find out which cluster's method is proper for a given numerical dataset. We tried to find the agglomerative hierarchical clustering method by testing the data that will be the optimal clustering algorithm among these three; K-Means, PAM, and Random Forest methods. By comparing each model's accuracy value with cultivar coefficients, we concluded that K-Means methods are the most helpful when working with numerical variables. On the other hand, PAM clustering and Gower with Random Forest are the most beneficial approaches when using categorical variables. These tests can determine the optimal number of clustering groups, given the data set, and by doing the proper analysis. Using those the project, we can apply our method to several industrial areas such that clinical, business, and others. For example, people can make different groups based on each patient who has a common disease, required therapy, and other things in the clinical society. Additionally, people can expect to get several clustered groups based on the marginal profit, marginal cost, or other economic indicators for the business area.

Today, with the development of technology, the decision-making capabilities of machines have also increased. With their high analytical skills, computers can easily catch points and relationships that may escape the human eye. Thanks to these capabilities, machines are also widely used in the field of health. For example, many machine learning techniques developed on cancer prediction have been successfully applied. Early detection of cancer is crucial to survival. In the early diagnosis of cancer, the rates of drug treatment, chemotherapy or radiotherapy that the person will be exposed to are significantly reduced and the patient gets through this process with the least amount of wear and tear. Gene Expression Cancer RNA-Seq Dataset was used in this study. This data set includes gene expression values of 5 cancer types (BRCA, KIRC, LUAD, LUSC, UCEC). DNA sequences in the dataset were analyzed using k-means and hierarchical clustering algorithms, which are unsupervised machine learning methods. The aim of the study is to develop a usable machine learning model for early detection of cancer at the gene level. Adjusted Rand Index (ARI), Silhouette Score, and Accuracy metrics were used to evaluate the analysis results. The rand index calculates similarity between clusters by counting the binaries assigned to clusters. The adjusted Rand Index is a randomly adjusted version of the Rand Index. The silhouette score indicates how well a data point fits within its own set among separated datasets. The accuracy metric is obtained as a percentage of correctly clustered data points divided by all predictions. Different connection methods are used in the hierarchical clustering algorithm. These are 'complete', 'ward', 'average' and 'single'. As a result of the study, the accuracy in the k-means algorithm was 0.990, the Adjusted Rand Index was 0.79, and the Silhouette Score was 0.14. Looking at the hierarchical clustering, ward performed the best of the four linkage methods, with an ARI score of 0.76 and a silhouette score of 0.13. As a result of the study, the accuracy of in the hierarchical clustering algorithm was 0.999.

Clustering is an effective unsupervised machine learning method that can be used as a stand-alone heuristic or as a part of a data mining process. The goal of clustering analysis is to partition data into groups with high intra-cluster association, and low inter-cluster association. Hierarchical clustering requires minimal parameters, has flexibility with similarity measure, and has strong visualization power, all of which makes it ideal for exploratory analysis. Hierarchical clustering is a particular branch of clustering algorithms where the results are not given as partitions, but rather a nested structure, which can represent the ordering among elements within a dataset. The study of the performance of hierarchical structure on time series data is limited. In this paper, we examine the hierarchical structure of time series datasets. The most popular hierarchical structured clustering heuristics include the Hierarchical Agglomerative Clustering, which is distance based; and Ordering Points To Identify the Clustering Structure, which is density based. Both share many similar characteristics and are suitable for time series data processing. We examine the performance of different hierarchical clustering algorithms with time series both internally as well as externally.

Clustering is one of the techniques used to obtain useful information from web log file for better understanding of customer behaviour. Two clustering techniques that commonly used are Greedy Hierarchical Item Set-Based Clustering (GHIC) algorithm and Hierarchical Clustering Algorithm (HCA). The algorithms, however, have its weaknesses in terms of processing times and time complexity. This paper proposes a new approach called Hierarchical Pattern-Based Clustering (HPBC) algorithm to improve the processing times based on the difference of mean support values of each cluster. The simulation revealed that the proposed algorithm outperformed the HCA and GHIC up to 100% and 50% respectively, with less time complexity.

Affinity propagation (AP) algorithm, as a novel clustering method, does not require the users to specify the initial cluster centers in advance, which regards all data points as potential exemplars (cluster centers) equally and groups the clusters totally by the similar degree among the data points. But in many cases there exist some different intensive areas within the same data set, which means that the data set does not distribute homogeneously. In such situation the AP algorithm cannot group the data points into ideal clusters. In this paper, we proposed an extended AP clustering algorithm to deal with such a problem. There are two steps in our method: firstly the data set is partitioned into several data density types according to the nearest distances of each data point; and then the AP clustering method is, respectively, used to group the data points into clusters in each data density type. Two experiments are carried out to evaluate the performance of our algorithm: one utilizes an artificial data set and the other uses a real seismic data set. The experiment results show that groups are obtained more accurately by our algorithm than OPTICS and AP clustering algorithm itself.