English

We have been using fuzzy data mining techniques to extract patterns that represent behavior for intrusion detection. We describe a variety of modifications that we have made to the data mining algorithms in order to improve accuracy and efficiency. We use sets of fuzzy association rules that are mined from network audit data as models of behavior. To detect anomalous behavior, we generate fuzzy association rules from new audit data and compute the similarity with sets mined from normal data. If the similarity values are below a threshold value, an alarm is issued. We describe an algorithm for computing fuzzy association rules based on Borgelt's (2001) prefix trees, modifications to the computation of support and confidence of fuzzy rules, a new method for computing the similarity of two fuzzy rule sets, and feature selection and optimization with genetic algorithms. Experimental results demonstrate that we can achieve better running time and accuracy with these modifications.

The rule representation opens a new dimension for expressing changes of fuzziness in fuzzy rule-based systems. In the case of standard Fuzzy rule representations, it is difficult to describe fuzzy functions in which crisp observations are required to have fuzzy conclusions, or in which an increase in the fuzziness of observations leads to reduced fuzziness in conclusions. These problems are mainly due to a lack of information. A fuzzy point rule determines the connection between a pair of fuzzy sets taken from the domain and the range of the rule. Expressing the fuzzy function through a set of fuzzy points and fuzzy interpolation between pairs of those points, each fuzzy point can be considered as a node point with given location and fuzziness. In common, sparse rule-base definitions, these node points are usually disjunctive on the domain, defining only single antecedent-consequent fuzziness connections at the location of the fuzzy points. However, this kind of information is insufficient when the goal is to express changes in the fuzziness of a given location in the domain. One solution to this problem is the double fuzzy point rule representation concept. Double fuzzy points are pairs of fuzzy points which share the same reference locations, but have different fuzziness properties. The existence of two different fuzziness values in a single location within the domain creates new possibilities for introducing fuzzy interpolation methods capable of interpolating not only between locations, but between changes in local fuzziness values as well. The main goal of this paper is to discuss how two-step Rule Interpolation methods can be adapted to be able to handle the double fuzzy point concept. To this end, an approach referred to as the Generalized Double Point Methodology (GDFPM) is proposed.

Rule extraction from data is one of the key technologies for solving the bottlenecks in artificial intelligence. Artificial neural networks are well suited for representing any knowledge in given data. Extraction of logical/fuzzy rules from the trained artificial neural network is of great importance to researchers in the fields of artificial intelligence and soft computing. Fuzzy rule sets are capable of approximating any nonlinear mapping relationships. Extraction of rules from data has been discussed in terms of fuzzy modeling, fuzzy clustering, and classification with fuzzy rule sets. This special issue entitled"Rule Extraction from Data" is aimed at providing the readers with good insights into the advanced studies in the field of rule extraction from data using neural networks/fuzzy rule sets. I invited seven research papers best suited for the theme of this special issue. All the papers were reviewed rigorously by two reviewers each. The first paper proposes an interesting rule extraction method from data using neural networks. Ishikawa presents a combination of learning with an immediate critic and a structural learning with forgetting. This method is capable of generating skeletal networks for logical rule extraction from data with correct and wrong answers. The proposed method is applied to rule extraction from lense data. The second paper presents a new methodology for logical rule extraction based on transformation of MLP (multilayered perceptron) to a logical network. Duck et al. applied their C-MLP2LN to the Iris benchmark classification problem as well as real-world medical data with very good results. In the third paper, Geczy and Usui propose fuzzy rule extraction from trained artificial neural networks. The proposed algorithm is implied from their theoretical study, not from heuristics. Their study enables to initially consider derivation of crisp rules from trained artificial neural network, and in case of conflict, application of fuzzy rules. The proposed algorithm is experimentally demonstrated with the Iris benchmark classification problem. The fourth paper presents a new framework for fuzzy modeling using genetic algorithm. The authors have broken new ground of fuzzy rule extraction from neural networks. For the fuzzy modeling, they have proposed a particular type of neural networks containing nodes representing membership functions. In this fourth paper, the authors discuss input variable selection for the fuzzy modeling under multiple criteria with different importance. A target system with a strong nonlinearity is used for demonstrating the proposed method. Kasabov, et al. present, in the fifth paper, a method for extraction of fuzzy rules that have different level of abstraction depending on several modifiable thresholds. Explanation quality becomes better with higher threshold values. They apply the proposed method to the Iris benchmark classification problem and to a real world problem. J. Yen and W. Gillespie address interpretability issue of Takagi-Sugeno-Kang model, one of the most popular fuzzy mdoels, in the fifth paper. They propose a new approach of fuzzy modeling that ensures not only a high approximation of the input-output relationship in the data, but also good insights about the local behavior of the model. The proposed method is applied to fuzzy modeling of sinc function and Mackey-Glass chaotic time series data. The last paper discusses fuzzy rule extraction from numerical data for high-dimensional classification problems. H.Ishibuchi, et al. have been pioneering methods for classification of data using fuzzy rules and genetic algorithm. In this last paper, they introduced a new criterion, simplicity of each rule, together with the conventional ones, compactness of rule base and classification ability, for high-dimensional problem. The Iris data is used for demonstrating their new classification method. They applied it also to wine data and credit data. I hope that the readers will be encouraged to explore the frontier to establish a new paradigm in the field of knowledge representation and rule extraction.

Detection of abnormal traffic and network intrusions based on multiple fuzzy rules

The central point in designing a fuzzy system for modeling and control is the generation of a set of efficient and effective fuzzy rules. Generally, fuzzy rules can be generated either from heuristics or from experimental data. Heuristic fuzzy rule generation, as discussed in Chapter 1, consists of the following main steps: Determination of the structure of the fuzzy systems. This includes mainly the selection of the inputs and outputs. Usually, a multi-input multi-output fuzzy systems can be decomposed into a number of multi-input single-output fuzzy systems. Definition of linguistic terms and their fuzzy membership function for each fuzzy variables. If a Mamdani fuzzy system is designed, each input and output can be seen as a linguistic variable. Therefore, it is necessary to define the linguistic terms (e.g., Small, Medium, Large etc.) and their fuzzy membership function. Details about the definition of a linguistic variable is presented in Section 1.2.1. Determination of fuzzy inference method. For example, for fuzzy mapping rules, the fuzzy Cartesian product can be used to define the fuzzy relation. Refer to Section 1.2.2. Defuzzification. If the Mamdani type fuzzy rules are used, the fuzzy output derived from the fuzzy rule base should be defuzzified. Refer also to Section 1.2.2 for different defuzzification methods. If the Takagi-Sugeno fuzzy rules are used, the defuzzification is included in the fuzzy inference and a crisp output is obtained directly.

In this paper, we introduce new fuzzy-neural networks – Fuzzy Set – based Polynomial Neural Networks (FSPNN) with a new fuzzy set-based polynomial neuron (FSPN) whose fuzzy rules include the information granules obtained through Information Granulation. We investigate the proposed networks from two different aspects to improve the performance of the fuzzy-neural networks. First, We have developed genetic optimization using Genetic Algorithms to find the optimal structure for fuzzy-neural networks. Second, we have been interested in the architecture of fuzzy rules that mimic the real world, namely sub-model composing the fuzzy-neural networks. We adopt fuzzy set-based fuzzy rules as substitute for fuzzy relation-based fuzzy rules and apply the concept of Information Granulation to the proposed fuzzy set-based rules. The performance of genetically optimized FSPNN (gFSPNN) with fuzzy set-based neural neuron (FSPN) involving information granules is quantified through experimentation.

Inferring descriptive and approximate fuzzy rules for credit scoring using evolutionary algorithms

Fuzzy rules automatically derived from a set of training examples quite often produce better classification results than fuzzy rules translated from medical knowledge. This study aims to investigate the difference in domain representation between a knowledge-based and a data-driven fuzzy system applied to an electrocardiography classification problem. For a three-class electrocardiographic arrhythmia classification task a set of fifteen fuzzy rules is derived from medical expertise on the basis of twelve electrocardiographic measures. A second set of fuzzy rules is automatically constructed on thirty-nine MIT-BIH database's records. The performances of the two classifiers on thirteen different records are comparable and up to a certain extent complementary. The two fuzzy models are then analyzed, by using the concept of information gain to estimate the impact of each ECG measure on each fuzzy decision process. Both systems rely on the beat prematurity degree and the QRS complex width and neglect the P wave existence and the ST segment features. The PR interval is not well characterized across the fuzzy medical rules while it plays an important role in the data-driven fuzzy system. The T wave area shows a higher information gain in the knowledge based decision process, and is not very much exploited by the data-driven system. The main difference between a human designed and a data driven ECG arrhythmia classifier is found about the PR interval and the T wave.

A genetic algorithm for generating fuzzy classification rules

Designing of classifiers based on immune principles and fuzzy rules

RST-BatMiner: A fuzzy rule miner integrating rough set feature selection and Bat optimization for detection of diabetes disease

Machine learning, data mining, and several related research areas are concerned with methods for the automated induction of models and the extraction of patterns from realistic data. Fuzzy classification is one of the important applications in fuzzy set where values ranges between 0 and 1 .Main objective of the fuzzy logic and fuzzy set to find a set of fuzzy rules that form a classification model. The set is major advantage of using fuzzy rules for classification applications to maintain transparency as well as high accuracy rate. Fuzzy pattern tree induction introduced as a novel for machine learning method for classification. Pattern tree is a hierarchical tree-like structure, whose inner nodes are marked with generalized (fuzzy) logical operators and whose leaf nodes are associated with fuzzy predicates on input attributes. Pattern tree make use of different aggregation including t-norms and t-conorms. There are two types of Fuzzy Pattern trees: (i) Bottom up induction: Information propagates from bottom to top. (ii) Top down induction: Information propagates from top to down. In this paper performance analysis and comparative study of above both approaches using number of parameters like accuracy rate, model size is mentioned. The paper is divided into five sections: section 1 is introduction of Fuzzy pattern tree, section 2 describes types of fuzzy pattern tree schemes and section 3 presents their comparative performance, section 4 does the conclusion. Section 5 includes future scope.

The aim of this paper is to present a detailed step by step method for classification of high resolution satellite imagery into defined classes such as high dense vegetation, water, wet land, Agricultural land etc., using fuzzy rule set. In this area, object based analysis is used for image classification. An Objectoriented approach isbased on the segmentation that is being followed for information extraction of variety of thematic information from high-resolution satelliteimagery. In this method, fuzzy rule set is defined for every class based on the class hierarchy; every defined class is assigned associated segments with high similarity degree, using eCognition Software. Object-oriented classification rule set provide a complete accurate and efficient method of information extraction. In compared the object-oriented with traditional pixel-based classification and proved that object-oriented method has provided high accuracy classification. Nearest Neighbor (NN) classification method was used to discriminate the land cover classes. The overall accuracy is obtained 99.99% and kappa coefficient obtained 99% for the satellite image of Landsat-8. Keyword: Classification, eCognition, Fuzzy rule based, High resolution satellite image, Segmentation.

Fuzzy controller design of micro-unmanned helicopter relying on improved genetic optimization algorithm

Association rules are frequently used for describing association (i.e., co-occurrence) among attribute values in the field of data mining. When an attribute is continuous (i.e., real-valued) such as height, length and weight, its domain is usually discretized into several intervals. Fuzzy rules are recognized as a convenient tool for handling continuous attributes in a human understandable manner. When we use fuzzy rules, the domain of each continuous attribute is discretized into several fuzzy sets. A linguistic label is usually associated with each fuzzy set especially when linguistic interpretations of fuzzy rules are required. In this paper, we first fuzzify the concept of association rules. That is, we show fuzzy versions of two measures (i.e., confidence and support) that are used for evaluating each association rule in the field of data mining. Then we illustrate these two measures of fuzzy rules for function approximation and pattern classification problems. Finally we examine the relation between the classification performance of fuzzy rules and the definition of their certainty grades through computer simulations. Simulation results show that the direct use of confidence as a certainty grade is not always appropriate from the viewpoint of classification performance.