A parameterised algorithm for mining association rules

SufRec, an algorithm for mining association rules: Recursivity and task parallelism

Parallel extraction of association rules from genomics data

While direct association rules are dedicated to describe the direct correlations among the items in a frequent itemset, indirect association rules are dedicated to describe the indirect correlations between the two items in a infrequent itemset. All the existing research works about indirect association rules are focused on improving the efficiency of mining algorithm for indirect association rules. Like incremental updating algorithm is important for mining association rules, incremental updating algorithm is also important for mining indirect association rules. In this paper, we put forward an incremental updating algorithm for mining indirect association rules to deal with the maintenance of discovered indirect association rules resulted from the change of the minimum support. The main idea is to re-utilize the results acquired in process with the old minimum support.

In order to solve these problems how to easily generate candidate frequent item sets and fast compute support of candidate item sets, an algorithm of association rules mining based on binary has been introduced. However, one presented binary mining algorithm is only suitable for mining some relative short frequent item sets since the way of generating candidate item sets is also similar to Apriori, another is only suitable for mining long frequent item sets, which generates candidate item sets by up-down search strategy. And so aiming to mining general frequent item sets, this paper proposes an algorithm of association rules double search mining based on binary, which is different from tradition association rules mining algorithm based on double search strategy. The algorithm doesn’t use combination of set theory to generate candidate item sets but binary logic operation that is also used to compute support of candidate item sets, which can use character digital to reduce the number of scanned transaction. The algorithm gets rid of shortage about some presented algorithms based on binary. The experiment based on above three algorithms indicates that the efficiency about double search strategy is fast and efficient when mining general frequent item sets which aren’t confined.

As an efficient data analysis tool, data mining can discover the potential association and regularity of massive data, and it has been widely used and played an important role in business decision, medical research and so on. However, the data mining technology is also a double-edged sword, in bringing convenience at the same time, will also cause the user’s privacy leak problem. In order to solve the problem, the symmetric searchable encryption technology is introduced into the association rule mining system to protect the privacy, and privacy preserving mining system of s (PP-MSAR) in OpenStack-based Cloud environment is designed. In order to solve the problem that the existing data mining algorithms can’t deal with large-scale data, this paper uses the computational power of Hadoop platform and add the global pruning technique to the existing algorithm based on MapReduce association rules, so that the counting of frequent item sets get reduced. At the same time, this paper add frequent matrix storage method into the distributed association rules algorithm and realize he algorithm of mining association rules for frequent matrix storage based on MapReduce. In addition, the introduction of symmetric searchable encryption technology to support the cloud server-side ciphertext retrieval, on the one hand to ensure that users stored in the database information will not be leaked to the outside for others, on the other hand also to ensure that the user data for the system staff confidential. Finally, we test the system, and the results show that the system can carry out association rules mining under the premise of protecting user privacy, and provide the correlation degree between data, which has certain practical significance and application value.

In recent years, the data mining technology has been developed rapidly. New efficient algorithms are emerging. Association data mining plays an important role in data mining, and the frequent item sets are the highest and the most costly. This paper is based on the association rules data mining technology. The advantages and disadvantages of Apriori algorithm and FP-growth algorithm are deeply analyzed in the association rules, and a new algorithm is proposed, finally, the performance of the algorithm is compared with the experimental results. It provides a reference for the extension and improvement of the algorithm of association rule mining.

To reduce invalid rules in the mining of association rules, we have analyzed the reasons and presented a relative confidence in the judgment criteria. Based on the value of relative confidence, we classify strong association rules into positive, invalid and negative association rules. We offer an algorithm of mining association rules with new judgment criterion and make tests with Visual FoxPro. The tests indicate that the new method stated in this paper can obviously reduce invalid association rules.

In the emerging networked environment we are encountering situations in which databases residing at geographically distinct sites must collaborate with each other to analyze their data together. But due to large sizes of the datasets it is neither feasible nor safe to transport large datasets across the network to some common server. We need algorithms that can process the databases at their own locations by exchanging needed information among them and obtain the same results that would have been obtained if the databases were merged. In this paper we present an algorithm for mining association rules from distributed databases by exchanging only the needed summaries among them.

Association rule is an important research topic in data mining and knowledge discovery. Traditional algorithms for mining association rules are built on the binary attributes databases, which has three limitations. Firstly, it can not concern quantitative attributes; secondly, it treats each item with the same significance although different item may have different significance; thirdly, only the direct association rules are discovered. Mining fuzzy association rules has been proposed to address the first limitation. In this paper, we put forward an idea for mining indirect weighted association rules to resolve the other two limitations, and a discovery algorithm for mining both direct and indirect weighted fuzzy association rules by integrating these three extensions.

Some problems of mining association rules with linguistic terms are discussed. First, an incremental updating algorithm of association rules with linguistic terms is presented. The collection of frequent linguistic attribute sets and its negative border along with their support count are maintained, which makes scan the entire database once at most in the process of updating association rules. The experiment shows that the updating algorithm can not only update association rules effectively but also avoid the repeated cost. Secondly, the parallel algorithm for mining association rules with linguistic terms is presented. The Boolean parallel mining algorithm is improved to discover frequent linguistic attribute sets, and the association rules with at least confidence are generated on all processors. This parallel mining algorithm has fine scale-up, size-up and speed-up.

Association rules mining is an important research topic in data mining and knowledge discovery. Traditional algorithms for mining association rules are built on the binary attributes databases, which has three limitations. Firstly, it cannot concern quantitative attributes; secondly, only the positive association rules are discovered; thirdly, it treat each item with the same significance although different item may have different significance. In this paper, we put forward a discovery algorithm for mining positive and negative fuzzy weighted association rules to resolve these three limitations.

This paper discusses the massive data processing method-Apriori algorithm for mining association rules. The Apriori algorithm repeatedly scans the database for shortcomings. Based on a Hadoop platform to block huge amounts of data, we provide the massive data processing method-Apriori algorithm for mining association rules.

Association rules mining is an important research topic in data mining and knowledge discovery. Traditional algorithms for mining association rules are built on the binary attributes databases, which has three limitations. Firstly, it can not concern quantitative attributes; secondly, only the positive association rules are discovered; thirdly, it treat each item with the same frequency although different item may have different frequency. In this paper, we put forward a discovery algorithm for mining positive and negative fuzzy association rules to resolve these three limitations.

Data mining has been attracted much attention from practitioners and researchers in recent years. Association rules are one of the most important research areas of data mining. Association Rule Mining (ARM) aims to discovers the relationship between the most frequent itemsets. Many algorithms have been developed for mining static datasets. It is nontrivial to maintain such discovered rules from large datasets, this was the main idea behind Incremental Association Rules Mining (IARM), which recently has received much attention from the Data Mining researcher. In this paper, a survey of Incremental Association Rule Mining (IARM) techniques and algorithms that had been developed are categorized and analyzed.

Machine-learning and data-mining techniques have been developed to turn data into useful task-oriented knowledge. Most algorithms for mining association rules identify relationships among transactions using binary values and find rules at a single-concept level. Transactions with quantitative values and items with hierarchical relationships are, however, commonly seen in real-world applications. This paper proposes a fuzzy multiple-level mining algorithm for extracting knowledge implicit in transactions stored as quantitative values. The proposed algorithm adopts a top-down progressively deepening approach to finding large itemsets. It integrates fuzzy-set concepts, data-mining technologies and multiple-level taxonomy to find fuzzy association rules from transaction data sets. Each item uses only the linguistic term with the maximum cardinality in later mining processes, thus making the number of fuzzy regions to be processed the same as the number of original items. The algorithm therefore focuses on the most important linguistic terms for reduced time complexity.