Selecting the correct Data Mining Method: Classification & InDaMiTe-R

Recent advances in computing, communications, digital storage technologies, and high-throughput data-acquisition technologies, make it possible to gather and store incredible volumes of data. It creates unprecedented opportunities for large-scale knowledge discovery from huge database. Data mining (DM) technology has emerged as a means of performing this discovery. There are countless researchers working on designing efficient data mining techniques, methods, and algorithms. Many data mining methods and algorithms have been developed and applied in a lot of application fields [1]. Unfortunately, most data mining researchers pay much attention to technique problems for developing data mining models and methods, while little to basic issues of data mining [2]. In this talk, some basic issues of data mining are addressed. What is data mining? What is the product of a data mining process? What are we doing in a data mining process? What is the rule we should obey in a data mining process? Through analyzing existing data mining methods, and domain-driven (or user-driven) data mining models [3-5], we find that we should take a data mining process as a process of knowledge transformation. Based on this understanding of data mining, a conceptual data mining model of domain-oriented data-driven data mining (3DM) is proposed [2]. The relationship between traditional domain-driven (or user-driven) data mining models and our proposed 3DM model is also analyzed. Some domain-oriented data-driven data mining algorithms for mining such knowledge as default rule [6], decision tree [7], and concept lattice [8] from database are proposed. The experiment results for these algorithms are also shown to illustrate the efficiency and performance of the knowledge acquired by our 3DM data mining algorithms.

The way we learn has changed as a result of advances in science and technology and the growing influence of information technology on daily life. E-learning is a relatively new concept in educational settings, but it has progressively earned a spot in modern training techniques. Data mining methods are used in many applications, particularly in elearning. Comparing direct communications difficult to track the student involvement in online courses. To overcome the above mentioned issues the existing methods are analyzed various techniques of data mining and optimization methods which can be applied to bring out hidden knowledge from the educational data? In the e-learning work, preprocessing, feature selection and classification process are performed to improve the Kalboard 360 educational dataset accuracy significantly. This study focused on educational data mining (EDM) and employed decision trees, support vector machines (SVM), multilayer perceptrons, and the naive bayesian C4.5 algorithm among other classification techniques to assess the features for the prediction of students’ behaviour and academic achievement. This paper analyzes the advantages and shortcomings of each algorithm applied to data set on the basis of accuracy for various classification techniques like Multilayer Perceptron based ANN algorithm (MP-ANN), Decision Tree (DT) C4.5 and Hybrid Regression model with Multi Label Classification (HR-MLC) approach. The experimental result shows that the HR-MLC algorithm provides better performance in terms of higher accuracy, precision, recall and f-measure rather than the other existing methods.

The aim of this research is to explore and analyze the benefits of risk classification methods by using data mining techniques on premium ratemaking in nonlife insurance. We rely on generalized linear models (GLMs) framework for nonlife premiums and examine the impact of specific data mining techniques on classifications of risk in motor hull insurance in Bosnia and Herzegovina. We study this relationship in an integrated framework considering a standard risk model based on the application of Poisson GLM for claims frequency estimate. Although GLM is a widely used method to determine insurance premiums, improvements of GLM by using the data mining methods identified in this paper may solve practical challenges for the risk models. The application of the data mining method in this paper aims to improve the results in the process of nonlife insurance premium ratemaking. The improvement is reflected in the choice of predictors or risk factors that have an impact on insurance premium rates. The following data mining methods for the selection of prediction variables were investigated: forward stepwise and neural networks. We provide strong and robust evidence that the use of data mining techniques influences premium ratemaking in nonlife insurance.KeywordsRatemakingForward stepwiseNeural networksNonlife insuranceGLM

Predictive analytics has emerged as a powerful tool in the field of financial engineering, enabling organizations to forecast trends, optimize strategies, and mitigate risks. Data mining techniques play a crucial role in extracting meaningful patterns from large volumes of financial datasets, contributing to the development of predictive modeling techniques. The purpose of this paper is to explore the application of various data mining techniques in predictive analytics within the financial sector, with a focus on their effectiveness in risk management, fraud detection, and portfolio optimization. Machine learning algorithms, such as decision trees, support vector machines, and neural networks, are increasingly being employed to model complex financial systems and enhance predictive accuracy. Additionally, techniques like clustering, association rule mining, and time series analysis are used to uncover hidden relationships and temporal patterns in financial datasets. Despite the significant advancements in these techniques, challenges remain in terms of data quality, computational complexity, and interpretability of results. This paper addresses these challenges and provides a comprehensive review of the most widely used data mining methods in financial engineering. Furthermore, it discusses the potential for future advancements in data mining algorithms and their integration with other emerging technologies like artificial intelligence and big data analytics. The findings indicate that while data mining offers significant potential in financial analytics, careful consideration must be given to the selection of appropriate techniques and the proper handling of data to ensure reliable predictions. Ultimately, this paper aims to contribute to the ongoing development of robust predictive modeling techniques in financial engineering by emphasizing the importance of data mining as an indispensable tool.

The trends of data mining on healthcare data for improving medical services have increased because of the electronic healthcare record(EHR) system, which collects a massive amount of data on a daily basis. In the current scenario, hospital maintains its EHR system and stores the detailed information of patients. Data mining for healthcare improvement requires the data from all the EHR systems located at a different location to be stored at the central data mining server. Collection of healthcare data at some untrusted central data mining server raises privacy threats. Healthcare data contains patients’ private information and sharing this information for data mining creates privacy issues. Most of the previous research either focused on k-anonymity technique which causes information loss and decreases data mining accuracy or privacy preserving data mining which is focused on only specific data mining technique. We adopt source anonymous technique as privacy preserving scheme and present a novel scheme for healthcare data collection and mining in this paper. Our scheme collects data from all EHR systems without any information loss and stores at a single central data mining server, also ensuring privacy is preserved. Central data mining server helps to analyze the collected data with different data mining techniques (Association rule mining, Classification, Clustering, etc.) without the involvement of EHR systems. Our scheme is collusion resilient against central data mining server and EHR systems. Theoretical and experimental analysis show the efficiency of our scheme in terms of computation and communication cost. The experimental results using Heart disease dataset show the advantage to EHR systems using the proposed approach in terms of disease prediction accuracy.

Education can be utilized as a tool to face many problems, overcome many hurdles in life. The knowledge obtained from education helps to enhance opportunities in one's employment development. To extract useful information from the knowledge obtained, Educational Data Mining is widely used. Educational data mining provides the process of applying different data mining tools and techniques to analyze and visualize the data of an institution (school) and can be used to discover a unique pattern of students' academic performance and behavior. The present work intends to enhance students' academic performance in secondary school using data mining techniques. Real data was collected using school reports and questionnaire method by the Portugal school which has been used in this paper. Naive Bayesian algorithm can be easily implemented to predict the students' academic performance and behavior. Classification of students into two classes, pass and fail, involves training phase and testing phase. In training phase, Naive Bayes classifier is built and in the testing phase, Naive Bayes classifier is used to make the prediction. The accuracy of the classifier is calculated using WEKA tool in which confusion matrix is generated. The accuracy of the classifier obtained is 87% which can be further improved by the selection of appropriate attributes. Developing the classification algorithms in this way helps to obtain a more efficient student performance predictor tool using other data mining algorithms and it also helps to improve the quality of education in an educational institution.

The escalating threat of fraud in financial institutions is a global issue, with the Malaysian sector being no exception. This study focuses on the implementation and efficacy of Data Mining and Machine Learning methodologies in identifying and mitigating fraudulent activities within these institutions. The paper critically reviews existing literature, bridging the gap between advanced technology application and fraud management. Fraudulent transactions in the financial sector are dynamic and sophisticated, requiring advanced detection techniques. Traditional approaches often struggle to manage this complexity effectively, demonstrating a need for more advanced and adaptive strategies. This is where Data Mining and Machine Learning techniques, renowned for their predictive and analytical prowess, can significantly contribute. Data Mining, the process of uncovering patterns and correlations within large datasets, is a useful tool for detecting anomalies that may suggest fraud. The study assesses various data mining techniques, such as clustering, classification, and association, and explores their application in detecting fraudulent transactions. Findings indicate that these techniques can substantially enhance fraud detection rates while minimizing false positives. Furthermore, Machine Learning, an artificial intelligence subset, has shown immense potential in fraud detection. Its ability to learn from and make decisions based on data makes it a viable solution for fraud detection. This paper explores both supervised and unsupervised learning algorithms and their efficacy in identifying fraud in the Malaysian financial sector. Results suggest that machine learning models, when correctly implemented, can significantly improve the accuracy of fraud detection. The review underscores the importance of employing advanced technologies like Data Mining and Machine Learning to combat financial fraud effectively. It also suggests future research directions, emphasizing the need for context-specific, localized models considering Malaysia's unique socio-economic environment. Moreover, the development of hybrid models, integrating both data mining and machine learning, could offer improved results. In conclusion, this study sets a precedent for further exploration into the application of advanced analytical tools in fraud detection in the Malaysian financial sector. The potential these technologies offer for improving accuracy and adaptability in fraud detection systems is substantial and warrants thorough investigation. Keywords: Fraud Detection, Malaysian Financial Institutions, Data Mining, Machine Learning, Financial Fraud Management

Educational data mining (EDM) is an up-coming interdisciplinary research field, in which data mining (DM) techniques applying in educational data. Its objective is to better understand how students gain knowledge and recognize the settings in which they learn to improve educational outcomes. Educational systems can store a huge amount of data that coming from multiple sources in different formats. Each particular educational problem requires different types of the mining techniques because traditional DM techniques cannot be applied directly to these types of data and problems. There are many general data mining tools are available but these are not designed for deal with educational data and an educator cannot use these tools without knowledge of data mining concepts. To overcome from this problem many authors provided educational data mining tools with different data mining techniques for different purposes. This paper surveys the EDM Tools from 2001 to 2016 and presents the consolidated list of tools in one place to help the EDM researchers. Then categorizes the tools based on data mining methods and explains the usage of EDM Tools.

The aim of this study is to highlight the importance of the unsupervised learning in Data mining and CRM fields. Data mining commonly known by its acronym KDD: knowledge discovery in data base, it refers to all methods and algorithms used for data exploration or prediction in large data bases volumes, Data mining is very important in various fields such as science, business and other areas deal with a large data set. CRM: Customer Relationship Management is an integrated information system that is used to plan, schedule and control the pre-sales and post-sales activities in an organization, both CRM and data mining techniques helps organizations maximize the value of every customer interaction and drive superior corporate performance. Clustering is one of the favoured used methods in data mining: The objective of this study is to implement the clustering algorithm K-Medoids via a shell script applied on a set of Analytical CRM data stored in Teradata environment.

Data mining and machine learning techniques can be applied to computer system design to aid in optimizing design decisions, improving system runtime performance. Data mining techniques have been investigated in the context of branch prediction. Specifically, a comparison of traditional branch predictor performance has been made to data mining algorithms. Additionally, the possiblity of whether additional features available within the architectural state might serve to further improve branch prediction has been evaluated. Results show that data mining techniques indicate potential for improved branch prediction, especially when register file contents are included as a feature set.

Cardiac arrest is a potentially fatal loss of heart function that occurs suddenly and without warning. Predicting cardiac arrest early could increase the likelihood of survival and allow for prompt treatment. The discipline of computer science known as “datamining” focuses on the process of gleaning useful information from massive databases. Algorithms for data mining can be used to look for trends in records that can indicate a cardiac arrest. Patients at high risk of cardiac arrest due to their medical history, lifestyle choices, or other variables can be pinpointed, for instance, with the help of data mining algorithms. Prediction of cardiac arrest using data mining techniques is discussed in this research. The chapter talks about the many data mining methods that have been employed for this, and the studies that have evaluated their efficacy. The chapter also covers the difficulties of employing data mining for early prediction of cardiac arrest, as well as potential future research avenues.

Controlled clinical trials are studies done by scientists on a concrete domain with the objective of execute a prospective analysis that attempts to compare the effect and value of one or more interventions in humans under specific conditions. Our case study is focused on applying artificial intelligence techniques to support scientists working on bio-nutritional trials, which rely on the study of the effect of consuming food with biomarkers on human health. This work is developed under the HENUFOOD2project. In order to simplify the domain, two trial stages are considered: the trial experimental execution and the trial data analysis. It is after the trial has been executed and all the information collected, when we try to discover non obvious knowledge among the trial data and support the scientists on their everyday analytical tasks. On the one hand, this analysis includes generic statistical manipulation and data discovery empowered by data mining techniques. On the other hand, a scientist support engine has been developed in order to allow non data manipulation and analysis experts to access the information and ask for new analysis processes. The approach, thanks to a user friendly interface enabled with query answering techniques, is able to interact with the user in a conversational mode and run analytical or data discovery processes, do a semantic search on previous indexed works or, finally, infer new rules to feed the expert system ontology. The expert system is not fully covered on this paper, as it will focus on the explanation of the usage of data mining and query answering techniques on that bio-nutritional focused expert system.

In the evolving landscape of financial markets, the convergence of data mining, cybersecurity, and algorithmic trading plays a pivotal role in enhancing trading performance and forensic investigations. This study investigates how data mining techniques are leveraged to extract meaningful patterns and trends from vast financial datasets, improving the accuracy and profitability of algorithmic trading strategies. By identifying historical trends, price movements, and trade margins, data mining enables traders to optimize decision-making processes and manage risks more effectively. Cybersecurity emerges as a critical factor in safeguarding both trading algorithms and sensitive financial data from cyber threats. The integration of advanced cybersecurity measures ensures the integrity, confidentiality, and availability of trading systems, reducing vulnerabilities that could be exploited by malicious actors. Additionally, forensic investigation techniques are employed to detect fraudulent trading activities, such as insider trading and market manipulation, thereby protecting market participants and maintaining regulatory compliance. This research highlights the importance of combining secure data mining practices with robust cybersecurity measures to enhance the overall performance of algorithmic trading systems. Furthermore, it explores how forensic methodologies can help detect anomalies and ensure the transparency and fairness of financial markets. Through an integrated approach, this study emphasizes the potential of data mining and cybersecurity in transforming trading operations while mitigating risks associated with cyber threats and financial fraud.

Digital systems record data on the books we read, items we purchase, or the products we enjoy, all within their own framework for the purpose of data mining. The information to be derived from these data through data mining methods is of great importance for these systems. Data mining aims to speed up the decision-making process by uncovering hidden relationships and information in data via mathematical and statistical techniques. In this context, data mining techniques were applied to the dataset containing book votes through the use of the Apriori algorithm in this study. In this way, the relationships within the data set were identified, rules were generated, and the connections between the generated rules and user preferences were disclosed. With the application of the Apriori algorithm, rules were generated that show books associated with other books, as well as authors often liked together with other authors. The study developed rules indicating which other books a reader might enjoy based on their interest in a particular book, as well as which authors might appeal to readers who like a given author. The rules produced in the study are intended to be used in book recommendation lists and sales strategies.

Data mining is a method that gives valuable information where we can improve and achieve the goal. Existing data mining techniques are applied in education for analyzing the performance of students, classes, and institutions. This helps the teachers and management to identify where they lag and improvise. Some mining techniques are used to predict and identify special children’s categories. In this paper, data mining techniques are applied for the special children to predict the achievement in special school study for child categories like Mental Retardation (MR), autism, and cerebral palsy using the collected assessment detail. Vocational training is considered an essential aspect for special school children for their future survival. Data mining methods are applied to mine the most achievable and essential training factors as a pattern by apriori rule mining and high utility pattern mining algorithms, based on their assessment achieved from the age 10–14, where Madras developmental programming scale is followed in special schools. We can predict which category children are achieving necessary factors, which helps identify the alternate methods to train the particular activity. Essential factors that cannot achieve at the same level will be trained in the next prevocational level to reach their vocational training. The prediction that we have made will be helpful for the teachers to train the children concerning their achievements.