- Book Chapter
8
- 10.1016/b978-044450270-4/50023-1
Second-Order Learning in Self-Organizing Maps
- Jan 01, 1999
- Kohonen Maps
- Ralf Der + 1 more +1
Second-Order Learning in Self-Organizing Maps
Since events and physical phenomena change with time, it is important to capture the main transitions and elements of such events and phenomena. Such transitions can be seen to occur in the World Wide Web (Levene & Poulovassilis, 2004), news topics (Allan, 2002), a person’s health condition, and the state of an instrument or a plant. Transition, or change, refers to a sequential increase/decrease or generation/extinction of the feature of the object. Visualization of such transitions of dynamic clusters is helpful in understanding such phenomena instinctively and plays a useful role in many application domains, such as fault diagnosis and medial examinations. Although a number of clustering methods have been proposed (Jain et al., 1999), most conventional clustering methods deal with static data and cannot handle sequential changes of the cluster explicitly. Tracing the trajectory within clusters that have been collectively processed and a sliding window-based method to generate separate clusters can be considered as simple methods. Although the former method cannot trace changes of clusters, it can trace changes in the number of data that belong to each cluster. The latter method can handle changes of clusters to a certain degree. However, there are some problems, such as setting an appropriate window size, the inevitable decrease in the number of data within a window, and the correspondence relationships of clusters between windows. The present study considers a window-based approach using the temporal neighborhood to address the above-described problems. Kohonen's Self-Organizing Map (SOM) (Kohonen, 2000) is considered to be an appropriate technique for visualizing clusters and their similarity relationships. The SOM is an unsupervised neural network learning technique that produces clusters and subsequently projects them onto a low-dimensional (normally two-dimensional) topology map. The conventional SOM deals with static data. However, we have extended the SOM learning model by introducing the Sequencing Weight Function (SWF), so that the model can visualize the transition of dynamics clusters. This model is referred to herein as the Sequence-based SOM (SbSOM) (Fukui et al., 2008). A SOM-based method was selected because the SOM has a neuron topology in the feature space and that is associated with topology (visualization) space. The introduction of temporal order into the topology is natural. The proposed method mitigates the problems of appropriate 7
Second-Order Learning in Self-Organizing Maps
Second-Order Learning in Self-Organizing Maps
Statistical Modelling by Topological Maps of Kohonen for Classification of the Physicochemical Quality of Surface Waters of the Inaouen Watershed Under Matlab
Self-organizing maps (SOMs) and other artificial intelligence approaches developed by Kohonen can be used to model and solve environmental challenges. To emphasize the classification of Physico-chemical parameters of the Inaouen watershed, we presented a classification strategy based on a self-organizing topological map (SOM) artificial neural network in this study. The use of a self-organizing map to classify samples resulted in the following five categories: Low quantities of Sodium Na (mg/l), Potassium k(mg/l), Magnesium Mg(mg/l), Calcium Ca(mg/l), Sulfates SO4(mg/l), and Total Dissolved Solids TDS (mg/l) distinguish Classes 2 and 3. Bicarbonate HCO3 (mg/l), Total Dissolved Solids TDS (mg/l), Total Alkalinity CaCO3(mg/l), Mg(mg/l), Calcium Ca (mg/l), and electrical conductivity Cond (ms/cm) are slightly greater in Classes 1 and 4. Except for Dissolved Oxygen D.O. (mg/l) and Nitrate NO3(mg/l), Class 5 has exceptionally high values for all metrics. The results suggest that Kohonen's self-organizing topological maps (SOM) classification is an outstanding and fundamental tool for understanding and displaying the spatial distribution of water physicochemical quality.
Read moreSpiking Self-organizing Maps for Classification Problem
Spiking Self-organizing Maps for Classification Problem
A neuro-fuzzy system for chemical agent detection
The authors previously introduced a fuzzy version of Kohonen's well-known self-organizing map neural network model. In this novel neuro-fuzzy system, the neurons of Kohonen's original model are replaced by fuzzy rules. Each fuzzy rule is composed of fuzzy sets and an output singleton. Since the fuzzy self-organizing map is a modified version of Kohonen's original model, the self-organizing map and the learning vector quantization learning laws can be used to tune the neuro-fuzzy system. Originally, the fuzzy self-organizing map was intended to be used as an unknown function approximator, while Kohonen's self-organizing map is primarily used as a neural classifier. In this paper, the authors show how the fuzzy self-organizing map can also be used as a neuro-fuzzy classifier. Simulation results show that, in chemical agent detection, the fuzzy self-organizing map not only gives better classification results than Kohonen's model, but it also has smaller number of fuzzy rules than the corresponding neurons required by Kohonen's self-organizing map.
Read moreAn analysis of Kohonen's self-organizing maps using a system of energy functions
In this paper a new method for analyzing Kohonen's self-organizing feature maps is presented. The method makes use of a system of energy functions, one energy function for each processing unit. It is shown that the training process is equivalent to minimizing each energy function subject to constraints. The analysis is used to prove the formation of topologically correct maps when the inherent dimensionality of the input patterns matches that of the network. The energy equations can be used to compute the steady-state weight values of the network. In addition, the analysis allows bounds on the training parameters to be determined. Finally, examples of energy landscapes are presented to graphically show the behavior of the network.
Read moreApplication of Self-Organizing Maps at Change Detection in Amazon Forest
This paper presents a change detection of aerial images algorithm based on Kohonen self-organizing maps. In this study, a set of images from different period of time from Tapajós National Forest at Amazon forest in Pará, Brazil, has been employed. As input of the self-organizing maps, used as an unsupervised neural network, it was obtained features from the images using three different size of square windows and as output, a map of 16 colors, as 16 groupings. The results are obtained through the comparison between the outputs obtained with these different sizes of windows.
Read moreCluster Analysis of Land-Cover Images Using Automatically Segmented SOMs with Textural Information
This work attempts to take advantage of the properties of Kohonen's Self-Organizing Map (SOM) to perform the cluster analysis of remotely sensed images. A clustering method which automatically finds the number of clusters as well as the partitioning of the image data is proposed. The data clustering is made using the SOM. Different partitions of the trained SOM are obtained from different segmentations of the U-matrix (a neuron-distance image) that are generated by means of mathematical morphology techniques. The different partitions of the trained SOM produce different partitions for the image data which are evaluated by cluster validity indexes. Seeking to guarantee even greater efficiency in the image categorization process, the proposed method extracts information from the image by means of pixel windows, in order to incorporate textural information. The experimental results show an application example of the proposed method on a TM-Landsat image.
Read moreHierarchical Clustering Analysis with SOM Networks
This work presents a neural network model for the clustering analysis of data based on Self Organizing Maps (SOM). The model evolves during the training stage towards a hierarchical structure according to the input requirements. The hierarchical structure symbolizes a specialization tool that provides refinements of the classification process. The structure behaves like a single map with different resolutions depending on the region to analyze. The benefits and performance of the algorithm are discussed in application to the Iris dataset, a classical example for pattern recognition.
Read more주성분 자기조직화 지도 PC-SOM
자기조직화 지도(SOM)은 T. 코호넨의 주도하에 개발된 비지도 학습 신경망 모형이다. 그 동안 패턴인식과 문서검색 분야에 주로 응용되어 왔기 때문에 통계학 분야에서는 덜 알려졌으나, 최근 K-평균 군집화에 대한 대안적 데이터 마이닝 기법으로 활용되기 시작하였다. 본 연구에서는 SOM의 한 버전인 PC-SOM(주성분 자기조직화 지도)을 제안하고 활용 예를 제시하고자 한다. PC-SOM은 1차원적 SOM 알고리즘을 반복 수행하여 2차원, 3차원 등의 SOM을 얻는 방법이기 때문에 기존 SOM과는 달리 사전 Map의 크기를 확정할 필요가 없다. 또한, 기존 SOM에 비하여 향상된 시각화를 가능하게 한다. Self-organizing map (SOM), a unsupervised learning neural network, has been developed by T. Kohonen since 1980's. Main application areas were pattern recognition and text retrieval. Because of that, it has not been spread to statisticians until late. Recently, SOM's are frequently drawn in data mining fields. Kohonen's SOM, however, needs improvements to become a statistician's standard tool. First, there should be a good guideline as for the size of map. Second, an enhanced visualization mode is wanted. In this study, principal components self-organizing map (PC-SOM), a modification of Kohonen's SOM, is proposed to meet such needs. PC-SOM performs one-dimensional SOM during the first stage to decompose input units into node weights and residuals. At the second stage, another one-dimensional SOM is applied to the residuals of the first stage. Finally, by putting together two stages, one obtains two-dimensional SOM. Such procedure can be easily expanded to construct three or more dimensional maps. The number of grid lines along the second axis is determined automatically, once that of the first axis is given by the data analyst. Furthermore, PC-SOM provides easily interpretable map axes. Such merits of PC-SOM are demonstrated with well-known Fisher's iris data and a simulated data set.
Read moreFast, efficient and accurate solutions to the Hamiltonian path problem using neural approaches
Fast, efficient and accurate solutions to the Hamiltonian path problem using neural approaches
Extending the Kohonen self-organizing map networks for clustering analysis
Extending the Kohonen self-organizing map networks for clustering analysis
A Study of Self- Organizing Maps(SOM) Neural Network Using Matlab
Kohonen's Self-Organizing Map ( SOM ) is one of the most popular artificial neural network algorithms. Bing unsupervised neural network , Self Organizing Maps( SOM ) have applications in different fields such as speech recognition, image processing and so on . This project includes a study of Self Organizing Maps neural network using MATLAB The structure, characteristics, implementation, applications and testing of this neural network for styles of one dimension and two dimensions have been considered It includes finding out the functions used for topology, and then finding out the distance function for this network throughout illustrative examples. Neural network implementation consists of three stages: Initialization (creation), Training, and Simulating. Explanation of the neighborhood concept is done. MATLAB software is used to perform how creating, training and simulating of a Self Organizing Map. Creation process consists of choosing a network parameters, plotting the results, then illustrating and identifying all functions used to create a Self Organizing Map. Training consists of weight initialization and weight vector creation. Simulating means testing the neural network using the initialization parameters and training vector created in the past two stages. The Study includes also four tests: The first test is used manual calculation procedure of the network mathematically. The other three tests are procedures for different applications using MATLAB language. It becomes evident from the graphs of the results that it’s essential to have the weight vectors for the coordination field greater than the density of input vectors in the case of employing the network to seclude the training styles in output cells. Keywords: Neural Network, Simulating, Self- Organizing Maps, Competitive layer, training DOI: 10.7176/RHSS/10-6-01 Publication date: March 31 st 2020
Read moreSelf-organizing operator map for nonlinear dimension reduction
Dimension reduction is an important problem arising e.g. in feature extraction, pattern recognition, and data compression. Often this is done using principal component analysis (PCA), but this approach is suitable only when the data are sufficiently linearly distributed. In this paper, neural network learning algorithms combining Kohonen's self-organizing map (SOM) and Oja's PCA rule are studied for the challenging task of nonlinear dimension reduction. The neural network has a structure of a self-organizing operator map where neurons, i.e. operators, are affine spaces instead of vectors. Adaptive algorithms derived from an optimization criterion are shortly reviewed, but the emphasis is on computationally more efficient and stable learning-rate free, K-means type batch algorithms. Simulations using image data show that the methods outperform the sequential methods proposed earlier.
Read moreAuto-SOM: recursive parameter estimation for guidance of self-organizing feature maps.
An important technique for exploratory data analysis is to form a mapping from the high-dimensional data space to a low-dimensional representation space such that neighborhoods are preserved. A popular method for achieving this is Kohonen's self-organizing map (SOM) algorithm. However, in its original form, this requires the user to choose the values of several parameters heuristically to achieve good performance. Here we present the Auto-SOM, an algorithm that estimates the learning parameters during the training of SOMs automatically. The application of Auto-SOM provides the facility to avoid neighborhood violations up to a user-defined degree in either mapping direction. Auto-SOM consists of a Kalman filter implementation of the SOM coupled with a recursive parameter estimation method. The Kalman filter trains the neurons' weights with estimated learning coefficients so as to minimize the variance of the estimation error. The recursive parameter estimation method estimates the width of the neighborhood function by minimizing the prediction error variance of the Kalman filter. In addition, the "topographic function" is incorporated to measure neighborhood violations and prevent the map's converging to configurations with neighborhood violations. It is demonstrated that neighborhoods can be preserved in both mapping directions as desired for dimension-reducing applications. The development of neighborhood-preserving maps and their convergence behavior is demonstrated by three examples accounting for the basic applications of self-organizing feature maps.
Read moreAnalyzing Facebook Data Set using Self-organizing Map
With an onset of social network amount of data is increasing day by day. In order to analyze the data and extract useful information, the data mining technology can be used. Clustering is one of the popular method of data mining. Clustering can be used for visualizing and analyzing of data. We are discussing Kohonen SOM. We are using neural networks, as a data mining tool which provides statistical observation and layout from big data-sets. We determine how Self-Organizing Kohonen Maps, can be efficiently used for data mining purposes. The Self Organizing Map (SOM) unsupervised learning is an effective computational tool in data mining processes. Self-Organizing Maps (SOMs) used to visualize social network dataset. We used Self-Organizing Map for clustering and analyzing high-dimensional and complex social network datasets. This paper also visualizes SOM neighbor connection, SOM neighbor weight distance, SOM weight position. We perform self organizing map algorithm for social network dataset in matlab.
Read more