A modified attribute reduction algorithm of consistent covering decision information systems

An incremental approach to attribute reduction from dynamic incomplete decision systems in rough set theory

Rough set theory is emerging as a powerful toll for reasoning about data. Attribute reduction is one of important topics in the research on the rough set theory. Heuristic, discernibility matrix and matrix method are three usually methods for designing attribute reduction algorithm in attribute reduction based on rough set. Some researchers use matrix method to design attribute reduction algorithm. The time complexity of the algorithm is O(|C| <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">3</sup> |U| <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> ), and the computation of the algorithm is time consuming. To lower the time complexity, it was first proposed a new matrix, and provided an attribute reduction definition based on the new matrix. Then it was proved that the new attribute reduction definition is the same as the old reduction. At last, we used the matrix of attribute to define the significance of attribute, and designed a new attribute reduction algorithm, which time complexity is cut to O(|C||U|)+O(|C| <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> |U/C| <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> ). At the same time, an example was used to illustrate the new algorithm.

Attribute Reduction problem is an important content in Rough Set theory, which has been proven to be NP-hard. It tends to find a subset of attributes that preserve the same discriminatory power as the entire attributes. Heuristics methods are used to find the minimum attribute subset. In this paper, we use three typical heuristic methods to do Attribute Reduction. They are positive-region-based, discernibility-matrix-based and mutual-information-based Attribute Reduction algorithm. Experimental results validate that all the three algorithms have good performance on classification for symbolic data. However, the computational complexity of the three Attribute Reduction algorithms are all O(n^2), so it s hard to apply them to massive data. In order to improve the efficiency of the three Attribute Reduction algorithms, we remodel the objective of them from the perspective of Submodular Function Optimization with submodular optimization strategies. We first optimize the attribute selection process with Lazy-Greedy strategy and then extend the serial algorithm to a parallel version according to the parallel optimization strategy of submodular functions. Experimental results validate that the efficiency of the proposed Attribute Reduction algorithms.

Knowledge reduction is an important issue when dealing with huge amounts of data. Rough set theory provides two fundamental concepts to deal with this special problem: attribute reduction and core, where attribute reduction is the key problem. There are a lot of methods available for attribute reduction, but very little work has been done for attribute reduction for the cases of deleting and modifying. Therefore, in this paper, we introduce a new updating method based on discernibility matrix for attribute reduction for the case of deleting. When a few old objects are deleted from a decision information system, a core and a new attribute reduction can be obtained quickly because it only deletes a few old rows and columns, or inserts a few rows and updates corresponding columns when updating the discernibility matrix.

As an effective tool for knowledge acquisition, attribute reduction is one of the key issues in rough set theory. In current research, most researchers choose to reduce redundant attributes as many as possible through some attribution reduction algorithms. However, the misclassification cost induced by attribute reduction is ignored. Thus, it is worth studying that how to reduce redundant attributes based on preserving the misclassification cost. Firstly, in this paper, the degree of minimum misclassification is defined. Then, by introducing decision process into variable precision rough set, a new model which is based on minimum misclassification cost with variable precision rough set (VPRS) is proposed. Moreover, based on the minimum misclassification cost, a heuristic attribute reduction algorithm is proposed. Finally, the simulation result shows that a feasible and reliable set of attributes can be obtained with our algorithm. These results further enrich attribute reduction to effectively deal with the uncertain classification problems.

Credit becomes an import issue for community and enterprise development. The development of internet makes available of enterprise credit data, which makes it possible to research enterprise credit evaluation. In this work, we propose an attribute reduction algorithm based on semantic analysis, rough set (RS) theory and conditional entropy. The collection of topic-related words is produced on the basis of semantic analysis and it is considered as the conditional attribute set. Then attribute reduction is actualised based on RS theory and conditional entropy. The method is applied to enterprise and community credit data which is available from the web. Extensive experiments on real-word data show that our method can obtain optimal attribute efficiently.

An improved attribute reduction scheme with covering based rough sets

A systematic study on attribute reduction with rough sets based on general binary relations

Granular maximum decision entropy-based monotonic uncertainty measure for attribute reduction

Rough sets provide a useful tool for data preprocessing during data mining. However, many algorithms related to some problems in rough sets, such as attribute reduction, are greedy ones. Matroids propose a good platform for greedy algorithms. Therefore, it is important to study the combination between rough sets and matroids. In this paper, we investigate rough sets and matroids through their operators, and provide a matroidal method for attribute reduction in information systems. Firstly, we generalize four operators of rough sets to four operators of matroids through the interior, closure, exterior and boundary axioms, respectively. Thus, there are four matroids induced by these four operators of rough sets. Then, we find that these four matroids are the same one, which implies the relationship about operators between rough sets and matroids. Secondly, a relationship about operations between matroids and rough sets is presented according to the induced matroid. Finally, the girth function of matroids is used to compute attribute reduction in information systems.

Attribute reduction based on overlap degree and k-nearest-neighbor rough sets in decision information systems

Distance metric learning-based multi-granularity neighborhood rough sets for attribute reduction

Attribute reduction plays an important role in rough set theory. It is an important application in data mining. In this paper, we focus on discussing the relation between set covering and attribute reduction in rough set theory. Based on the equivalence between minimal set covering and minimal attribute reduction sets, attribute reduction graph (ARG) is constructed. A novel algorithm to find the minimal attribute reduction sets, which is based on combination of binary discernibility matrix and graph theory is proposed in this paper. This algorithm demonstrates its efficiency and feasibility by an example.

Attribute reduction is one of the most important research issues in the rough set theory. The purpose of attribute reduction is to find a minimal attribute subset that satisfies some specific criteria, while the minimal attribute subset is called attribute reduct. In this paper, we define a similarity-based attribute reduct based on a clustering perspective. Each decision class is treated as a cluster, and the defined similarity-based attribute reduct can maintain or increase the discriminating ability of different clusters in the case of removing redundant attributes. In view of this, firstly, we define the intra-class similarity for objects in the same decision class and the inter-class similarity for objects between different decision classes. Secondly, we define a similarity-based attribute reduct by maximizing intra-class similarity and minimizing inter-class similarity in the rough set model. Thirdly, by considering the heuristic search strategy, we also design a corresponding reduction method for the proposed attribute reduct. The experimental results indicate that compared with other representative attribute reducts, our proposed attribute reduct can significantly improve the classification performance.

Attribute reduction plays an important role in knowledge discovery and data mining. Confronted with data characterized by the interval and missing values in many data analysis tasks, it is interesting to research the attribute reduction for interval-valued data with missing values. Uncertainty measures can supply efficient viewpoints, which help us to disclose the substantive characteristics of such data. Therefore, this paper addresses the attribute reduction problem based on uncertainty measure for interval-valued data with missing values. At first, an uncertainty measure is provided for measuring candidate attributes, and then an efficient attribute reduction algorithm is developed for the interval-valued data with missing values. To improve the efficiency of attribute reduction, the objects that fall within the positive region are deleted from the whole object set in the process of selecting attributes. Finally, experimental results demonstrate that the proposed algorithm can find a subset of attributes in much shorter time than existing attribute reduction algorithms without losing the classification performance.