Implementation of Different Data Mining Algorithms with Neural Network

Recent advances in computing, communications, digital storage technologies, and high-throughput data-acquisition technologies, make it possible to gather and store incredible volumes of data. It creates unprecedented opportunities for large-scale knowledge discovery from huge database. Data mining (DM) technology has emerged as a means of performing this discovery. There are countless researchers working on designing efficient data mining techniques, methods, and algorithms. Many data mining methods and algorithms have been developed and applied in a lot of application fields [1]. Unfortunately, most data mining researchers pay much attention to technique problems for developing data mining models and methods, while little to basic issues of data mining [2]. In this talk, some basic issues of data mining are addressed. What is data mining? What is the product of a data mining process? What are we doing in a data mining process? What is the rule we should obey in a data mining process? Through analyzing existing data mining methods, and domain-driven (or user-driven) data mining models [3-5], we find that we should take a data mining process as a process of knowledge transformation. Based on this understanding of data mining, a conceptual data mining model of domain-oriented data-driven data mining (3DM) is proposed [2]. The relationship between traditional domain-driven (or user-driven) data mining models and our proposed 3DM model is also analyzed. Some domain-oriented data-driven data mining algorithms for mining such knowledge as default rule [6], decision tree [7], and concept lattice [8] from database are proposed. The experiment results for these algorithms are also shown to illustrate the efficiency and performance of the knowledge acquired by our 3DM data mining algorithms.

Noting that several rule discovery algorithms in data mining can produce a large number of irrelevant or obvious rules from data, there has been substantial research in data mining that addressed the issue of what makes rules truly 'interesting'. This resulted in the development of a number of interestingness measures and algorithms that find all interesting rules from data. However, these approaches have the drawback that many of the discovered rules, while supposed to be interesting by definition, may actually (1) be obvious in that they logically follow from other discovered rules or (2) be expected given some of the other discovered rules and some simple distributional assumptions. In this paper we argue that this is a paradox since rules that are supposed to be interesting, in reality are uninteresting for the above reason. We show that this paradox exists for various popular interestingness measures and present an abstract characterization of an approach to alleviate the paradox. We finally discuss existing work in data mining that addresses this issue and show how these approaches can be viewed with respect to the characterization presented here.

Preparing a data set for analysis is generally the most time consuming task in a data mining project, requiring many complex SQL queries, joining tables and aggregating columns. Existing SQL aggregations have limitations to prepare data sets because they return one column per aggregated group. In general, a significant manual effort is required to build data sets, where a horizontal layout is required. We propose simple, yet powerful, methods to generate SQL code to return aggregated columns in a horizontal tabular layout, returning a set of numbers instead of one number per row. This new class of functions is called horizontal aggregations. Horizontal aggregations build data sets with a horizontal denormalized layout (e.g. point-dimension, observation-variable, instance-feature), which is the standard layout required by most data mining algorithms. We propose three fundamental methods to evaluate horizontal aggregations: CASE: Exploiting the programming CASE construct; SPJ: Based on standard relational algebra operators (SPJ queries); PIVOT: Using the PIVOT operator, which is offered by some DBMSs. Experiments with large tables compare the proposed query evaluation methods. Our CASE method has similar speed to the PIVOT operator and it is much faster than the SPJ method. In general, the CASE and PIVOT methods exhibit linear scalability, where as the SPJ method does not. In a relational database, especially with normalized tables, a significant effort is required to prepare a summary data set that can be used as input for a data mining or statistical algorithm. Most algorithms require as input a data set with a horizontal layout, with several Records and one variable or dimension per column. That is the case with models like clustering, classification, regression and PCA; consult. Each research discipline uses different terminology to describe the data set. In data mining the common terms are point-dimension. Statistics literature generally uses observation-variable. Machine learning research uses instance-feature. This article introduces a new class of aggregate functions that can be used to build data sets in a horizontal layout (denormalized with aggregations), automating SQL query writing and extending SQL capabilities. We show evaluating horizontal aggregations is a challenging and interesting problem and we introduced alternative methods and optimizations for their efficient evaluation. II. MOTIVATION As mentioned above, building a suitable data set for data mining purposes is a time- consuming task. This task generally requires writing long SQL statements or customizing SQL Code if it is automatically generated by some tool. There are two main ingredients in such SQL code: joins and aggregations; we focus on the second one. The most widely- known aggregation is the sum of a column over groups of rows. Some other aggregations return the average, maximum, minimum or row count over groups of rows. There exist many aggregations functions and operators in SQL. Unfortunately, all these aggregations have limitations to build data sets for data mining purposes. The main reason is that, in general, data sets that are stored in a relational database (or a data warehouse) come

This paper describes an approach to identify the state of a power system using Data Mining Algorithms. With the advent of Phasor Measurement Units (PMU), a huge amount of power system data is being stored day-to-day in the Phasor Data Collectors (PDCs). Knowledge discovery and machine learning techniques can make use of this data to extract valuable information and interesting patterns in these databases. In this paper, Symbolic Aggregate ApproXimation (SAX) is used to convert the time stamped phasor data from the PMUs into symbolic strings and Data Mining (DM) algorithms are used to predict the current state of a power system. Along with the state, the location and cause of disturbance is also identified in minimal time. The effectiveness of different DM algorithms for determining state of a power system is also shown using the measures of accuracy, precision and recall.

Recent developments in computing, communications, digital storage technologies, and high-throughput data-acquisition technologies, make it possible to gather and store incredible volumes of data. It creates unprecedented opportunities for knowledge discovery large-scale database. Data mining technology is a useful tool for this task. It is an emerging area of computational intelligence that offers new theories, techniques, and tools for processing large volumes of data, such as data analysis, decision making, etc. There are countless researchers working on designing efficient data mining techniques, methods, and algorithms. Unfortunately,most data mining researchers pay much attention to technique problems for developing data mining models and methods, while little to basic issues of data mining. What is data mining? What is the product of a data mining process? What are we doing in a data mining process? What is the rule we would obey in a data mining process? What is the relationship between the prior knowledge of domain experts and the knowledgemind from data? In this paper, we will address these basic issues of data mining from the viewpoint of informatics [1]. Data is taken as a manmade format for encoding knowledge about the natural world. We take data mining as a process of knowledge transformation. A domain-oriented data-driven data mining (3DM) model based on a conceptual data mining model is proposed. Some data-driven data mining algorithms are also proposed to show the validity of this model, e.g., the data-driven default rule generation algorithm, data-driven decision tree pre-pruning algorithm and data-driven knowledge acquisition from concept lattice.

The Outlier detection is very active area of research in data mining where outlier is a mismatched data in dataset with respect to the other available data.In existing approaches the outlier detection done only on numeric dataset.For outlier detection if we use clustering method , then they mainly focus on those elements as outliers which are lying outside the clusters but it may possible that some of the unknown elements with any possible reasons became the part of the cluster so we have to concentrate on that also.The Proposed method uses hybrid approach to reduce the number of outliers.The number of outlier can only reduce by improving the cluster formulation method.The proposed method uses two data mining techniques for cluster formulation i.e. weighted k-means and neural network where weighted kmeans is the clustering technique that can apply on text and date data set as well as numeric data set.Weighted kmeans assign the weights to each element in dataset.The output of weighted k-means becomes the input for neural network where the neural network is the classification and clustering technique of data mining.Training is provided to the neural network and according to that neurons performed the testing.The neural network test the cluster formulated by weighted k-means to ensure that the clusters formulated by weighted k-means are group accordingly.There is lots of outlier detection methods present in data mining.The proposed method use Integrating Semantic Knowledge (SOF) for outlier detection.This method detects the semantic outlier where the semantic outlier is a data point that behaves differently with other data points in the same class or cluster.The main motive of this research work is to reduce the number of outliers by improving the cluster formulation methods so that outlier rate reduces and also to decrease the mean square error and improve the accuracy.The simulation result clearly shows that proposed method works pretty well as it significantly reduces the outlier.

Intelligent computing system based on pattern recognition and data mining algorithms

Use of machine learning (ML) and data mining (DM) algorithms has surfaced more often in the recent years for disease risk prediction problems in the healthcare communities. Several traditional feature selection models are combined with the DM and ML algorithms to improve accuracy of the disease risk prediction. In this study, a new Bio-inspired Ensemble Feature Selection (BEFS) model is introduced which is applied with the DM and ML algorithms. In the BEFS model, the most relevant and highly contributing features in the prediction are determined with a bio-inspired algorithm i.e., genetic algorithm, and an ensemble algorithm i.e., random forest algorithm. These important features obtained from the proposed model are then combined in various combinations and applied with the DM and ML algorithms, here logistic regression (LR) and random forest (RF), and the results obtained are promising. The experiment is executed using the famous ML language R. To accomplish this objective, the Breast Cancer Wisconsin (Diagnostic) dataset of UCI (University of California, Irvine) ML repository is utilized. In the experimental outcomes, the highest accuracy attained with the BEFS model is 96.49%, the AUC (Area Under Curve) achieved is 96%, and the sensitivity is 98.11%. These results, which greatly improve the disease risk prediction, are higher than several other existing works, while utilizing only six most relevant features out of the thirty two features of the dataset.

Medical datasets hold huge number of records about the patients, the doctors and the diseases. The extraction of useful information which will provide knowledge in decision making process for the diagnosis and treatment of the diseases are becoming increasingly determinant. Knowledge Discovery and data mining make use of Artificial Intelligence (AI) algorithms which are applied to discover hidden patterns and relations in complex datasets using intelligent agents. The existing data mining algorithms and techniques are designed to solve the individual problems, such as classification or clustering. Up till now, no unifying theory is developed.Among the different algorithms in data mining for prediction, classification, interpretation and visualization, ‘k-means clustering’, ‘Decision Trees (C4.5)’, ‘Neural Network (NNs)’ and ‘Data Visualization (2D or 3D scattered graphs)’ algorithms are frequently utilized in data mining tools. The choice of the algorithm depends on the intended use of extracted knowledge.In this paper, the mentioned algorithms are unified into a tool, called Unified Medical Data Miner (UMDM) that will enable prediction, classification, interpretation and visualization on a diabetes dataset.KeywordsMedicineClusteringClassification & PredictionVisualizationAgent Data miningUnified Medical Data Miner

There are many data mining algorithms and methodologies for various fields and various problematic. Each data mining researcher/practitioner should describe the intrinsic quality of the discovered models and patterns. In addition he/she is faced with assessing the performance of his/her own solution(s) in order to make –fair– comparisons with state of the art approaches. Which methodology, which benchmarks, which measures of performance, which tools, which measures of interest, which scenarios, etc., should be used, and why? Every one should answer these questions, and assessing the quality and the performance of a data mining process is a critical issue. Assessing the quality and the performance is a critical issue for classical situations and even more in the Big Data era where we can not manage this issue with classical and current approaches. Clearly, large scale data, complex data and streaming data bring new challenges (e.g. large scale inference, fake correlations, necessity of perpetual validation). In this setting, the Quality Issues, Measures of Interestingness and Evaluation of data mining models Workshop series provide an open forum for intensive discussions and the exchange of new ideas and best practices on quality issues among data mining researchers. QIMIE focuses on the theory, the techniques, the links between the discovery stage and the quality assessment stage, and the practices that can ensure that the discovered knowledge of a data mining process is of quality. It is organized with the IEEE Task Force on Evaluation and Quality issues (Data Mining and Big Data Analytics Technical Committee, IEEE Computational Intelligence Society).

Electronic payments is something that is currently in high demand by investors today, but transactions are often constrained due to various problems, especially from third parties. For this reason, cryptocurrency emerged, which is one of the solutions for conducting electronic payment transactions. Some types of cryptocurrency that are most in demand by investors are bitcoin, ethereum, and ripple. The fluctuation value of cryptocurrency is very difficult to predict so that investors often experience losses when making transactions. This study aims to predict cryptocurrency prices such as bitcoin, ethereum and ripple using data mining algorithms. The data mining algorithm used in this prediction process is K-NN, Neural Network, SVM, Linear Regression, Random Forest and Decision Tree. Data mining modeling is done by dividing the dataset into each type of commodity and then analyzed using each algorithm. The results of this study indicate that the accuracy value obtained from some data mining algorithms is good enough to predict cryptocurrency prices

Objectives: The nonlinearity of the stock market is widely accepted all over the world and to reveal such non-linearity the most effective technique has proved to be constructed through application of either data mining or neural network. Pharmaceutical sector is a rapidly growing in Bangladeshi stock market. The objective of this paper is to investigate whether the hybridization of data mining and neural network technique can be applied in predicting the stock price for Pharmaceutical sector of Dhaka Stock Exchange (DSE). Methods/Analysis: This study uses daily trade data for Pharmaceutical sector of DSE. We have analysed the behaviour of daily average price for Pharmaceutical sector of DSE. For this study, 6 top listed pharmaceutical companies have been selected to perform the analysis and selected time frame for the research is 15 years (2000-2015). The analysis is performed in two stages where first stage performs the K-means clustering of data mining method to discover the stock with most useful pattern and second stage applies the nonlinear autoregressive with Exogenous Input neural network method to predict the closing price for the selected stock. Findings: The prediction performance through the hybridization of data mining and neural network technique is evaluated and positive performance improvement of prediction is observed which is very encouraging for investors. The research also depicts that hybridization of data mining and neural network technique can be applied in determining the stock investment decision for Pharmaceutical sector of DSE though the impact of many different information has greater influence in determining the stock price. Novelty/Improvement: We intend to apply the data mining and optimized neural network in predicting stock market. We would like to work with the parameter and learning of the neural network to achieve better result. We will further investigate the effect of various factors viz. dollar price, gold price, FDI, bank interest rate etc. on stock price and index movement.

This paper presents a hybrid approach that integrates a genetic algorithm (GA) and data mining to produce control signatures. The control signatures define the best parameter intervals leading to a desired outcome. This hybrid method integrates multiple rule sets generated by a data mining algorithm with the fitness function of a GA. The solutions of the GA represent intersections among rules providing tight parameter bounds. The integration of intuitive rules provides an explanation for each generated control setting and it provides insights into the decision making process. The ability to analyze parameter trends and the feasible solutions generated by the GA with respect to the outcomes is another benefit of the proposed hybrid method. The presented approach for deriving control signatures is applicable to various domains, such as energy, medical protocols, manufacturing, airline operations, customer service, and so on. Control signatures were developed and tested for control of a power plant boiler. These signatures discovered insightful relationships among parameters. The results and benefits of the proposed method for the power plant boiler are discussed in the paper.

Data mining (DM) research has successfully developed advanced DM techniques and algorithms over the last few decades, and many organisations have great expectations to take more benefit of their data warehouses in decision making. Currently, the strong focus of most DM-researchers is still only on technology-oriented topics. Commonly the DM research has several stakeholders, the major of which can be divided into internal and external ones each having their own point of view, and which are at least partly conflicting. The most important internal groups of stakeholders are the DM research community and academics in other disciplines. The most important external stakeholder groups are managers and domain experts who have their own utility-based interests to DM and DM research results. In this paper we discuss these practice-oriented points of view towards DM research and suggest broader discussions inside the DM research community about who should do that kind of research. We bring in the discussion several topics developed in the information systems (IS) discipline and show some similarities between IS and DM systems. DM systems have also their own peculiarities and we conclude that researchers who take into account human and organisational aspects related to DM systems need to have also some understanding about DM. This makes us suggest that the research area inside the DM community should be made broader than the current heavily technology-oriented one.

Robot basketball is an emerging cross-discipline, involving robotics, intelligent control and image processing, computer vision and other fields, but as the amount of data collected by the system increases sharply, this information comes from different times and uses different expressions As the amount of information continues to increase, its effectiveness is limited. The purpose of this article is to study the positioning of the basketball robot’s target recognition system based on data mining algorithms. Based on the research of data mining, support vector machines and related technologies, this paper establishes an SVM method to realize basketball robot target recognition. Experimental research shows that, according to the measurement accuracy characteristics of the binocular vision system, when the object distance L=500mm~600mm is used, the relative error of the measurement is small and the system accuracy is high.