APRIORI MULTIPLE ALGORITHM FOR MINING ASSOCIATION RULES

Multi-dimensional semantic clustering of large databases for association rule mining

In this paper, we examine the issue of mining association rules among items in a large database of sales transactions. The mining of association rules can be mapped into the problem of discovering large itemsets where a large itemset is a group of items which appear in a sufficient number of transactions. The problem of discovering large itemsets can be solved by constructing a candidate set of itemsets first and then, identifying, within this candidate set, those itemsets that meet the large itemset requirement. Generally this is done iteratively for each large k-itemset in increasing order of k where a large k-itemset is a large itemset with k items. To determine large itemsets from a huge number of candidate large itemsets in early iterations is usually the dominating factor for the overall data mining performance. To address this issue, we propose an effective hash-based algorithm for the candidate set generation. Explicitly, the number of candidate 2-itemsets generated by the proposed algorithm is, in orders of magnitude, smaller than that by previous methods, thus resolving the performance bottleneck. Note that the generation of smaller candidate sets enables us to effectively trim the transaction database size at a much earlier stage of the iterations, thereby reducing the computational cost for later iterations significantly. Extensive simulation study is conducted to evaluate performance of the proposed algorithm.

Association rule is an important research topic in data mining and knowledge discovery. Traditional algorithms for mining association rules are built on the binary attributes databases, which has three limitations. Firstly, it can not concern quantitative attributes; secondly, it treats each item with the same significance although different item may have different significance; thirdly, only the direct association rules are discovered. Mining fuzzy association rules has been proposed to address the first limitation. In this paper, we put forward an idea for mining indirect weighted association rules to resolve the other two limitations, and a discovery algorithm for mining both direct and indirect weighted fuzzy association rules by integrating these three extensions.

Association rules mining is an important research topic in data mining and knowledge discovery. Traditional algorithms for mining association rules are built on the binary attributes databases, which has three limitations. Firstly, it cannot concern quantitative attributes; secondly, only the positive association rules are discovered; thirdly, it treat each item with the same significance although different item may have different significance. In this paper, we put forward a discovery algorithm for mining positive and negative fuzzy weighted association rules to resolve these three limitations.

Because of the rapid growth in worldwide information, efficiency of association rules mining (ARM) has been concerned for several years. In this paper, based on the original Apriori algorithm, an improved algorithm IAA is proposed. IAA adopts a new count-based method to prune candidate itemsets and uses generation record to reduce total data scan amount. Experiments demonstrate that our algorithm outperforms the original Apriori and some other existing ARM methods.

Some problems of mining association rules with linguistic terms are discussed. First, an incremental updating algorithm of association rules with linguistic terms is presented. The collection of frequent linguistic attribute sets and its negative border along with their support count are maintained, which makes scan the entire database once at most in the process of updating association rules. The experiment shows that the updating algorithm can not only update association rules effectively but also avoid the repeated cost. Secondly, the parallel algorithm for mining association rules with linguistic terms is presented. The Boolean parallel mining algorithm is improved to discover frequent linguistic attribute sets, and the association rules with at least confidence are generated on all processors. This parallel mining algorithm has fine scale-up, size-up and speed-up.

To reduce invalid rules in the mining of association rules, we have analyzed the reasons and presented a relative confidence in the judgment criteria. Based on the value of relative confidence, we classify strong association rules into positive, invalid and negative association rules. We offer an algorithm of mining association rules with new judgment criterion and make tests with Visual FoxPro. The tests indicate that the new method stated in this paper can obviously reduce invalid association rules.

Coronary Heart Disease (CHD) is a ordinary cardiovascular disease which does gravely harm to humans' health. It belongs to the category of chest stuffiness and pains on usual Indian Medicine. Many more researcher work on the association improvement is a very important research field in data mining. The mining association rule recurrently has been adopting numerous replica support, confidence, interestingness. But this model can't accurate determine the correlative degree between the precursor and the major of the rule by allocation. So we proposed a new mining algorithm of association rules. Proposed a new system based SVM,fuzzy Discriminant support. Our propose Coronary Heart Disease prediction system quantitatively estimate the correlation of rules and reduce many rules that have low support or have no correlation or have negative correlation. In our work we conduct experiments on large real time rural and urban data set and to predict the diseases like Medication in Coronary Heart Disease.

Geographic object flow is the reason behind the relationship of geographic units. There are interactions in the process of dynamic change of a geographic object flow, and its regularity, which can reflect the relationship or pattern of geographic units in a region. In this paper, an association rule mining method for the geographic object flow linkage process is studied from a geoeconomics perspective. Additionally, an association rule mining algorithm with hierarchical constraints is proposed. Data segmentation is performed according to the time series characteristics of geographic object flow data. The basic attributes for the association rule mining are determined based on the basic parameters of geographic object flows, and a database for the association rule mining is formed according to the characteristics of the hierarchical structure of the geographic object flows. Based on the obtained data, the association rule mining algorithm with hierarchical constraints obtained using a parent–child matrix is improved by adding the Apriori algorithm. With the Indo-Pacific region as an example, the trade flow association rules for 25 countries in the region from 2010 to 2021 are selected. In addition, a mathematical statistical analysis of the strongly associated mined trade flows and geoeconomic factors is conducted in terms of both a basic feature analysis of trade flow associations and a country-oriented trade flow association analysis by considering domain knowledge. The effectiveness of the method has been evaluated from various perspectives such as correlation analysis, mathematical statistics, and comparison with the findings of existing studies and proved the validity of the method.

As an efficient data analysis tool, data mining can discover the potential association and regularity of massive data, and it has been widely used and played an important role in business decision, medical research and so on. However, the data mining technology is also a double-edged sword, in bringing convenience at the same time, will also cause the user’s privacy leak problem. In order to solve the problem, the symmetric searchable encryption technology is introduced into the association rule mining system to protect the privacy, and privacy preserving mining system of s (PP-MSAR) in OpenStack-based Cloud environment is designed. In order to solve the problem that the existing data mining algorithms can’t deal with large-scale data, this paper uses the computational power of Hadoop platform and add the global pruning technique to the existing algorithm based on MapReduce association rules, so that the counting of frequent item sets get reduced. At the same time, this paper add frequent matrix storage method into the distributed association rules algorithm and realize he algorithm of mining association rules for frequent matrix storage based on MapReduce. In addition, the introduction of symmetric searchable encryption technology to support the cloud server-side ciphertext retrieval, on the one hand to ensure that users stored in the database information will not be leaked to the outside for others, on the other hand also to ensure that the user data for the system staff confidential. Finally, we test the system, and the results show that the system can carry out association rules mining under the premise of protecting user privacy, and provide the correlation degree between data, which has certain practical significance and application value.

A novel software defect prediction approach via weighted classification based on association rule mining


 
 
 
 Apriori algorithm is a classical algorithm of association rule mining and widely used for generating frequent item sets. However, the original Apriori algorithm has some limitation such as it needs to scan the dataset many times to discover all frequent itemset and generate huge number of candidate itemset. To overcome these limitations, researchers have made a lot of improvements to the Apriori such as candidate generation, without candidate generation, transaction reduction, partitioning, and sampling. When it comes to mine massive data, these algorithms failed to prove efficiency because limitation of the processing capacity, storage capacity, and main memory constraints. Therefore, parallel and distributed algorithms are developed to perform large-scale computing in ARM on multiple processors. However, the problems with most of the parallel and distributed framework are overheads of managing distributed system, lack of high level parallel programming language, and node failures. Hadoop-MapReduce is an efficient, scalable, and simplified programming model for massive data processing and it also available on cloud environment. Cloud computing offers huge computing resources, and capacities to solve big data challenges. Recently many parallel algorithms have been proposed on Hadoop-MapReduce to enhance the performance of Apriori algorithm but there are some drawbacks: since multiple scan over the dataset is needed to generate candidate itemset, it consume more execution time. The aim of this study is to propose a parallel Transaction Reduction MapReduce Apriori algorithm (TRMR-Apriori) which is reduce unnecessary transaction values and transactions from the dataset in parallel manner to overcome above problems. The experiments show that TRMR-Apriori is able to achieve better execution time to discover frequent itemset those of previous sequential ARM algorithms such as Apriori, AprioriTid, Eclat, and FP-Growth and the previous parallel algorithms such as PApriori, MRApriori, and Modified Apriori with different condition on homogeneous computing environment using Hadoop-MapReduce platform in cloud. Overall, the TRMR-Apriori shows the strength to extract the frequent itemset from massive dataset in cloud.
 
 
 
 

Big data has become one of the key sources for valuable information and as information becomes larger it poses some computational challenge in finding a best possible solution for mining association rules and discovering patterns in data. Meta-heuristic algorithm when applied to mining association rules aims to find best possible rules from data without being stuck in local optimal. Example of meta-heuristics algorithm includes genetic algorithm and particle swarm optimization algorithm. Finding appropriate representation of various types of patterns using rough numerical values attributes is still a challenge because most association rules cannot be applied to numerical data without discretization which may lead to information loss. Mining numeric association rules is a hard optimization problem rather than being a discretization, thus, this paper proposes a new meta-heuristic algorithm which uses wolf search algorithm (WSA) for numeric association rule mining from rough values within tolerable ranges.

Association rule mining (ARM) is a commonly encountred data mining method. There are many approaches to mining frequent rules and patterns from a database and one among them is heuristics. Many heuristic approaches have been proposed but, to the best of our knowledge, there is no comprehensive literature review on such approaches, yet with only a limited attempt. This gap needs to be filled. This paper reviews heuristic approaches to ARM and points out their most significant strengths and weaknesses. We propose eight performance metrics, such as execution time, memory consumption, completeness, and interestingness, we compare approaches against these performance metrics and discuss our findings. For instance, comparison results indicate that SRmining, PMES, Ant‐ARM, and MDS‐H are the fastest heuristic ARM algorithms. HSBO‐TS is the most complete one, while SRmining and ACS require only one database scan. In addition, we propose a parameter, named GT‐Rank for ranking heuristic ARM approaches, and based on that, ARMGA, ASC, and Kua emerge as the best approaches. We also consider ARM algorithms and their characteristics as transactions and items in a transactional database, respectively, and generate association rules that indicate research trends in this area.This article is categorized under: Algorithmic Development > Association Rules Technologies > Association Rules Fundamental Concepts of Data and Knowledge > Motivation and Emergence of Data Mining

Association rules mining is an important research topic in data mining and knowledge discovery. Traditional algorithms for mining association rules are built on the binary attributes databases, which has three limitations. Firstly, it can not concern quantitative attributes; secondly, only the positive association rules are discovered; thirdly, it treat each item with the same frequency although different item may have different frequency. In this paper, we put forward a discovery algorithm for mining positive and negative fuzzy association rules to resolve these three limitations.