- Research Article
53
- 10.1016/j.ins.2015.03.006
Bias-correction fuzzy clustering algorithms
- Mar 14, 2015
- Information Sciences
- Miin-Shen Yang + 1 more +1
Bias-correction fuzzy clustering algorithms
In this paper, we show how one can take advantage of the stability and effectiveness of object data clustering algorithms when the data to be clustered are available in the form of mutual numerical relationships between pairs of objects. More precisely, we propose a new fuzzy relational algorithm, based on the popular fuzzy C-means (FCM) algorithm, which does not require any particular restriction on the relation matrix. We describe the application of the algorithm to four real and four synthetic data sets, and show that our algorithm performs better than well-known fuzzy relational clustering algorithms on all these sets.
Bias-correction fuzzy clustering algorithms
Bias-correction fuzzy clustering algorithms
Big Data Technology for Comparative Study of K-Means and Fuzzy C-Means Algorithms Performance
Big data is technology that has the ability to manage very large amounts of data, in very fast time to allow real-time analysis and reactions. Several clustering methods which are used to group data are Fuzzy C-Means (FCM) and K-Means Clustering. K-Means Clustering algorithm is a method of partitioning existing data into two or more group. This research goal was to compare the performance of K-Means and Fuzzy C-Means algorithms in clustering data using big data technology. In this research, Hadoop and Hive were chosen the big data technology. The knowledge of Shia history on student and lecturer of Syarif Hidayatullah State Islamic University Jakarta were the data which used in this research, The testing was done by constructing application K-Means Fuzzy C-Means using Java language, Hadoop and Hive and then test the performance of K-Means and Fuzzy C-Means algorithms in data clustering. It compares both algorithms in terms of accuracy, execution time, and time complexity of the algorithms. In the application K-Means Fuzzy C-Means, evaluation were performed with data filter and the average accuracy difference result of K-Means and Fuzzy C-Means is 8.03% with the better accuracy owned by K-Means. The average execution time difference is 718.58 ms, which K-Means was faster than is Fuzzy C-Means. The time complexities of both algorithms have the same value O(n2) and the Big O equation resulted in an average difference of 93,568 with the smallest value on K-Means. Thus, K-Means algorithm is better than the Fuzzy C-Means in terms of accuracy, execution time, and the time complexity.
Read moreImproved Fingerprint-Based Localization Based on Sequential Hybridization of Clustering Algorithms
The localization accuracy of a fingerprint-based localization system is dependent on several factors, one of which is the accuracy and efficiency at which the fingerprint database is clustered. Most highly efficient and accurate clustering algorithms have high time-dependent computational complexity (CC), which tends to limit their practical applicability. A technique that has yet to be explored is the sequential hybridization of multiple low-time CC clustering algorithms to produce a single moderate-time CC clustering algorithm with high localization accuracy. As a result, this paper proposes a clustering algorithm with a moderate time CC that is based on the sequential hybridization of the closest access point (CAP) and improved k-means clustering algorithms. The performance of the proposed sequential hybrid clustering algorithm is determined and compared to the modified affinity propagation clustering (m-APC), fuzzy c-mean (FCM), and 2-CAP algorithms presented in earlier research works using four experimentally generated and publicly available fingerprint databases. The performance metrics considered for the comparisons are the position root mean square error (RMSE) and clustering time based on big O notation. The simulation results show that the proposed sequential hybrid clustering algorithm has improved localization accuracy with position RMSEs of about 54%, 77%, and 52%, respectively, higher than those of the m-APC, FCM, and 2-CAP algorithms. In terms of clustering time, it is 99% and 79% faster than the m-APC and FCM algorithms, respectively, but 90% slower than the 2-CAP algorithm. The results have shown that it is possible to develop a clustering algorithm that has a moderate clustering time with very high localization accuracy through sequential hybridization of multiple clustering algorithms that have a low clustering time with poor localization accuracy. Doi: 10.28991/ESJ-2024-08-02-02 Full Text: PDF
Read moreDetermination of Optimal Clusters Using a Genetic Algorithm
Clustering is a potential tool of data mining. A clustering method analyzes the pattern of a data set and groups the data into several clusters based on the similarity among themselves. Clusters may be either crisp or fuzzy in nature. The present chapter deals with clustering of some data sets using Fuzzy C-Means (FCM) algorithm and Entropy-based Fuzzy Clustering (EFC) algorithm. In FCM algorithm, the nature and quality of clusters depend on the pre-defined number of clusters, level of cluster fuzziness and a threshold value utilized for obtaining the number of outliers (if any). On the other hand, the quality of clusters obtained by the EFC algorithm is dependent on a constant used to establish the relationship between the distance and similarity of two data points, a threshold value of similarity and another threshold value used for determining the number of outliers. The clusters should ideally be distinct and at the same time compact in nature. Moreover, the number of outliers should be as minimum as possible. Thus, the above problem may be posed as an optimization problem, which will be solved using a Genetic Algorithm (GA). The best set of multi-dimensional clusters will be mapped into 2-D for visualization using a Self-Organizing Map (SOM).
Read moreComparison of two fuzzy algorithms in geodemographic segmentation analysis: The Fuzzy C-Means and Gustafson–Kessel methods
Comparison of two fuzzy algorithms in geodemographic segmentation analysis: The Fuzzy C-Means and Gustafson–Kessel methods
Read moreEffective Fuzzy Clustering Algorithm for Abnormal MR Brain Image Segmentation
Clustering approach is widely used in biomedical applications particularly for brain tumor detection in abnormal magnetic resonance (MR) images. Fuzzy clustering using fuzzy C-means (FCM) algorithm proved to be superior over the other clustering approaches in terms of segmentation efficiency. But the major drawback of the FCM algorithm is the huge computational time required for convergence. The effectiveness of the FCM algorithm in terms of computational rate is improved by modifying the cluster center and membership value updation criterion. In this paper, the application of modified FCM algorithm for MR brain tumor detection is explored. Abnormal brain images from four tumor classes namely metastase, meningioma, glioma and astrocytoma are used in this work. A comprehensive feature vector space is used for the segmentation technique. Comparative analysis in terms of segmentation efficiency and convergence rate is performed between the conventional FCM and the modified FCM. Experimental results show superior results for the modified FCM algorithm in terms of the performance measures.
Read moreEffects of Weights in Weighted Fuzzy C-Means Algorithm for Room Equalization at Multiple Locations
This paper shows that a choice of weights in the fuzzy c-means algorithm affect the performance of a room equalizer. The ordinary fuzzy c-means (FCM) algorithm already proves useful to deriving an equalizing filter for multiple listeners. A room impulse response models the behaviour of the sounds reflection in the room at each listener location. The FCM algorithm finds similar room impulse responses based on Euclidean distances among the impulse responses and groups them together. But the Euclidean distance used in the FCM implies equal weights for all parts of sound reverberation or reflection. The paper proposes an algorithm to obtain a room acoustic equalization filter based on weighted fuzzy c-means (WFCM) algorithm. The use of WFCM can give clustering more flexibility in obtaining a prototype for each cluster. Then combining the prototypes to obtain a representative room response that derives the inverse filter will be more effective. We use spectral deviation to measure how well each equalizing filter works. Experiments show that different weights in the WFCM algorithm can enhance or degrade the performance of the equalizing filter.
Read morePerformance research of Gaussian function weighted fuzzy C-means algorithm
Fuzzy C-Means (FCM) algorithm is a fuzzy pattern recognition method. Clustering precision of the algorithm is affected by its equal partition trend for data set of large discrepancy of each class samples number, and the optimal clustering result of the algorithm mightn't be a right partition in this case. In order to overcome this disadvantage, a Gaussian function Weighted Fuzzy C-Means (WFCM) algorithm is proposed, which the weighted function is produced by a Gaussian function calculating dot density of each sample. To certain extent, the WFCM algorithm has not only overcome the limitation of equal partition trend in fuzzy Cmeans algorithm, but also been favorable convergence and stability. The calculation of the weighted function and the choice of sample dot density range restriction value for the algorithm are both objective. When partially supervised information obtained from a few labeled samples is introduced to the WFCM algorithm, the classification performance of the WFCM algorithm is further enhanced and the convergent speed of objective function is further accelerated.
Read moreRelative Density Weights Based Fuzzy C-Means Clustering Algorithms
Fuzzy C-means (FCM) clustering algorithm tries to get the memberships of each sample to each Cluster by optimizing an objective function, and then assign each of the samples to an appropriate class. The Fuzzy C-means algorithm doesn’t fit for clusters with different sizes and different densities, and it is sensitive to noise and anomaly. We present two improved fuzzy c-means algorithms, Clusters-Independent Relative Density Weights based Fuzzy C-means (CIRDWFCM) and Clusters-Dependent Relative Density Weights based Fuzzy C-means (CDRDWFCM), according to the various roles of different samples in clustering. Several experiments of them are done on four datasets from UCI and UCR. Experimental results shows that this two presented algorithms can increase the similarity or decrease the iterations to some extent, and get better clustering results and improve the clustering quality.
Read moreGradient based fuzzy c-means (GBFCM) algorithm
In this paper, a clustering algorithm based on the fuzzy c-means algorithm (FCM) and the gradient descent method is presented. In the FCM, the minimization process of the objective function is proceeded by solving two equations alternatively in an iterative fashion. Each iteration requires the use of all the data at once. In our proposed approach one datum at a time is presented to the network, and the minimization is proceeded using the gradient descent method. Compared to FCM, the experimental results show that our algorithm is very competitive in terms of speed and stability of convergence for large number of data. >
Read moreA Fuzzy Crow Search Algorithm for Solving Data Clustering Problem
The crow is one of the most intelligent bird and infamous for observing other birds so that they can steal their food. The crow search algorithm (CSA), a nature-based optimizer, is inspired by the social behavior of crows. Scholars have applied the CSA to obtain efficient solutions to certain function and combinatorial optimization problems. Another popular and powerful method with several real-world applications (e.g., energy, finance, marketing, and medical imaging) is fuzzy clustering. The fuzzy c-means (FCM) algorithm is a critical fuzzy clustering approach given its efficiency and implementation easily. However, the FCM algorithm can be easily trapped in the local optima. To solve this data clustering problem, this study proposes a hybrid fuzzy clustering algorithm combines the CSA and a fireworks algorithm. The algorithm performance is evaluated using eight well-known UCI benchmarks. The experimental analysis concludes that adding the fireworks algorithm improved the CSA’s performance and offered better solutions than those by other meta-heuristic algorithms.
Read moreA robust method for online heart sound localization in respiratory sound based on temporal fuzzy c-means.
This work presents a detailed framework to detect the location of heart sound within the respiratory sound based on temporal fuzzy c-means (TFCM) algorithm. In the proposed method, respiratory sound is first divided into frames and for each frame, the logarithmic energy features are calculated. Then, these features are used to classify the respiratory sound as heart sound (HS containing lung sound) and non-HS (only lung sound) by the TFCM algorithm. The TFCM is the modified version fuzzy c-means (FCM) algorithm. While the FCM algorithm uses only the local information about the current frame, the TFCM algorithm uses the temporal information from both the current and the neighboring frames in decision making. To measure the detection performance of the proposed method, several experiments have been conducted on a database of 24 healthy subjects. The experimental results show that the average false-negative rate values are 0.8 ± 1.1 and 1.5 ± 1.4 %, and the normalized area under detection error curves are 0.0145 and 0.0269 for the TFCM method in the low and medium respiratory flow rates, respectively. These average values are significantly lower than those obtained by FCM algorithm and by the other compared methods in the literature, which demonstrates the efficiency of the proposed TFCM algorithm. On the other hand, the average elapsed time of the TFCM for a data with length of 0.2 ± 0.05 s is 0.2 ± 0.05 s, which is slightly higher than that of the FCM and lower than those of the other compared methods.
Read moreUnsupervised learning network based on gradient descent procedure of fuzzy objective function
Fuzzy clustering has been playing an important role in solving many problems. Fuzzy c-means (FCM) algorithm is most frequently used for fuzzy clustering. But some fixed points of FCM algorithm, known as Tucker's counter example, is not a reasonable solution. Moreover, the FCM algorithm is impossible to perform online learning since it is basically a batch learning scheme. This paper presents an unsupervised learning network as an attempt to improve the shortcomings of conventional clustering algorithms. This model integrates the optimization function of FCM algorithm into an unsupervised learning network. The learning rule of the proposed scheme is a result of formal derivation based on the gradient descent procedure of fuzzy objective function. Using the result of formal derivation, two implementations of the proposed scheme, the batch learning version and online learning version, are devised. They are tested on Chiou's data and Iris data and compared with FCM. Experimental results show that the proposed scheme derived the reasonable solution on Tucker's counter example.
Read moreThe potential of using fuzzy clustering in generating consumer profile
A good consumer profile can be developed by forming a suitable group of criteria. However, the most common existing consumer profile was created based on statistical averages where overlapping between characteristics does not exist. This paper discussed the potential of using the fuzzy clustering method to develop a suitable consumer profile. Fuzzy C-Means (FCM) algorithm has been selected to construct consumer profile from two different data sets; domestic water consumption and electricity consumption data sets. The result obtained using FCM algorithm was compared to the results produced by hard clustering algorithm and statistical method. The findings showed that fuzzy clustering has the potential to create a very informative consumer profile.
Read moreA Modified Fuzzy C-means Algorithm in Remote Sensing Image Segmentation
Fuzzy C-Means (FCM) algorithm has good clustering efficiency, for which it is widely used in the field of image segmentation. However, problems such as weak robustness of distance measure, the number of initial clustering to be given in advance and not considering local image feature still exist. In essence, FCM is a local search algorithm. Improper selection of initial value will lead to the need for more iterations and convergence to local optimal solution. By combining evolving clustering (ECM) with FCM algorithm, a new method of remote sensing image segmentation is put forward. By using FCM algorithm to solve the choice of ECM's initialization clustering centers and using FCM to optimize the obtained centers, fuzzy clustering is completed. And by converting fuzzy into a certainty classification, clustering segmentation is realized. The algorithm is typical of relatively less iterations of convergence to global optimum, good stability and robustness. Experiment results show that it helps to produce better segmentation effect and improve the efficiency of remote sensing image segmentation.
Read more