Ubiquitous Mining with Interactive Data Mining Agents

Recent advances in computing, communications, digital storage technologies, and high-throughput data-acquisition technologies, make it possible to gather and store incredible volumes of data. It creates unprecedented opportunities for large-scale knowledge discovery from huge database. Data mining (DM) technology has emerged as a means of performing this discovery. There are countless researchers working on designing efficient data mining techniques, methods, and algorithms. Many data mining methods and algorithms have been developed and applied in a lot of application fields [1]. Unfortunately, most data mining researchers pay much attention to technique problems for developing data mining models and methods, while little to basic issues of data mining [2]. In this talk, some basic issues of data mining are addressed. What is data mining? What is the product of a data mining process? What are we doing in a data mining process? What is the rule we should obey in a data mining process? Through analyzing existing data mining methods, and domain-driven (or user-driven) data mining models [3-5], we find that we should take a data mining process as a process of knowledge transformation. Based on this understanding of data mining, a conceptual data mining model of domain-oriented data-driven data mining (3DM) is proposed [2]. The relationship between traditional domain-driven (or user-driven) data mining models and our proposed 3DM model is also analyzed. Some domain-oriented data-driven data mining algorithms for mining such knowledge as default rule [6], decision tree [7], and concept lattice [8] from database are proposed. The experiment results for these algorithms are also shown to illustrate the efficiency and performance of the knowledge acquired by our 3DM data mining algorithms.

The trends of data mining on healthcare data for improving medical services have increased because of the electronic healthcare record(EHR) system, which collects a massive amount of data on a daily basis. In the current scenario, hospital maintains its EHR system and stores the detailed information of patients. Data mining for healthcare improvement requires the data from all the EHR systems located at a different location to be stored at the central data mining server. Collection of healthcare data at some untrusted central data mining server raises privacy threats. Healthcare data contains patients’ private information and sharing this information for data mining creates privacy issues. Most of the previous research either focused on k-anonymity technique which causes information loss and decreases data mining accuracy or privacy preserving data mining which is focused on only specific data mining technique. We adopt source anonymous technique as privacy preserving scheme and present a novel scheme for healthcare data collection and mining in this paper. Our scheme collects data from all EHR systems without any information loss and stores at a single central data mining server, also ensuring privacy is preserved. Central data mining server helps to analyze the collected data with different data mining techniques (Association rule mining, Classification, Clustering, etc.) without the involvement of EHR systems. Our scheme is collusion resilient against central data mining server and EHR systems. Theoretical and experimental analysis show the efficiency of our scheme in terms of computation and communication cost. The experimental results using Heart disease dataset show the advantage to EHR systems using the proposed approach in terms of disease prediction accuracy.

With the growing technology and amount of data, the use of cloud and centralized servers is increasing. When the data of the individuals is stored by the third party it leads to the insecurity of misuse of their information in the individuals. Data Mining is carried on this data stored over cloud to get useful information, analysis and decision making purposes. But along with the process of mining, privacy preservation is the key concern. While performing data mining over large set of data there are chances of privacy violation, loss of information, loss of privacy of individuals. While concentrating only on preserving privacy can increase inefficiency and complexity of data mining techniques. Techniques used for achieving privacy lead to a significant information loss. The methods concerned about information loss generally lack behind in achieving a good level of privacy. Thus it is important to find the efficient data mining technique which can preserve privacy without causing high loss of information. This paper analyses various privacy preserving data mining techniques for their pros and cons and then gives a proposed concept to achieve privacy with minimum information loss.

Five high-quality workshops were held at the 13th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD 2009) in Bangkok, Thailand during April 27-30, 2009. There were 17, 6, 9, 4 and 5 accepted papers to be presented at the Pacific Asia Workshop on Intelligence and Security Informatics (PAISI 2009), the workshop on Advances and Issues in Biomedical Data Mining (AIBDM 2009), the workshop on Data Mining with Imbalanced Classes and Error Cost (ICEC 2009), the workshop on Open Source in Data Mining (OSDM 2009), and the workshop on Quality Issues, Measures of Interestingness and Evaluation of Data Mining Models (QIMIE 2009). One competition, PAKDD 2009 Data Mining Competition, and one local workshop, Thai Track Session, were arranged. From these workshops (except PAISI which published its works in separate LNCS proceedings), we selected two or three best papers for this LNCS publication. PAKDD is a major international conference in the areas of data mining (DM) and knowledge discovery in database (KDD). It provides an international forum for researchers and industry practitioners to share their new ideas, original research results and practical development experiences from all KDD-related areas including data mining, data warehousing, machine learning, databases, statistics, knowledge acquisition and automatic scientific discovery,data visualization, causal induction and knowledge-based systems.

With the requirement to find methods to analysis the rapidly increasing data, as a branch of computer science, data mining technique has been widely apply in different domain .One of the most enticing application areas of data mining in these emerging technologies is in finance. To complete the financial tasks, data mining technique is used refer to Stock market forecasting, Bankruptcy Prediction, Credit Risk Estimation, Corporate Performance Prediction and Management Fraud. This paper focuses on new data mining applications in finance. The fast development of Compute technology (such as Cloud Computing) and database together gives data mining a new challenge and chance in data mining of finance. How to apply the new computer and database technique to the data mining, and integrate the previous framework and the new technology together to build a more efficiency and safer framework is a long way to go in the future . Meanwhile, after accumulate enough empirical regularity and experiences, deep field-specific theories will be set up. This means, in the future, it will have more standardized and accurate model and method to apply in different domain of finance by generating more empirical regularities and combining them with domain knowledge.

Education can be utilized as a tool to face many problems, overcome many hurdles in life. The knowledge obtained from education helps to enhance opportunities in one's employment development. To extract useful information from the knowledge obtained, Educational Data Mining is widely used. Educational data mining provides the process of applying different data mining tools and techniques to analyze and visualize the data of an institution (school) and can be used to discover a unique pattern of students' academic performance and behavior. The present work intends to enhance students' academic performance in secondary school using data mining techniques. Real data was collected using school reports and questionnaire method by the Portugal school which has been used in this paper. Naive Bayesian algorithm can be easily implemented to predict the students' academic performance and behavior. Classification of students into two classes, pass and fail, involves training phase and testing phase. In training phase, Naive Bayes classifier is built and in the testing phase, Naive Bayes classifier is used to make the prediction. The accuracy of the classifier is calculated using WEKA tool in which confusion matrix is generated. The accuracy of the classifier obtained is 87% which can be further improved by the selection of appropriate attributes. Developing the classification algorithms in this way helps to obtain a more efficient student performance predictor tool using other data mining algorithms and it also helps to improve the quality of education in an educational institution.

Recent developments in computing, communications, digital storage technologies, and high-throughput data-acquisition technologies, make it possible to gather and store incredible volumes of data. It creates unprecedented opportunities for knowledge discovery large-scale database. Data mining technology is a useful tool for this task. It is an emerging area of computational intelligence that offers new theories, techniques, and tools for processing large volumes of data, such as data analysis, decision making, etc. There are countless researchers working on designing efficient data mining techniques, methods, and algorithms. Unfortunately,most data mining researchers pay much attention to technique problems for developing data mining models and methods, while little to basic issues of data mining. What is data mining? What is the product of a data mining process? What are we doing in a data mining process? What is the rule we would obey in a data mining process? What is the relationship between the prior knowledge of domain experts and the knowledgemind from data? In this paper, we will address these basic issues of data mining from the viewpoint of informatics [1]. Data is taken as a manmade format for encoding knowledge about the natural world. We take data mining as a process of knowledge transformation. A domain-oriented data-driven data mining (3DM) model based on a conceptual data mining model is proposed. Some data-driven data mining algorithms are also proposed to show the validity of this model, e.g., the data-driven default rule generation algorithm, data-driven decision tree pre-pruning algorithm and data-driven knowledge acquisition from concept lattice.

Data is ubiquitous in our cities. However, designing a knowledge network about our cities is an arduous task, given that data sensed cannot be used directly, human significance must be added. Adding human significance can be achieved via an automated “expert system (ES)” in which domain expert knowledge are stored in a knowledge-based repository. The domain expert knowledge is matched with the corresponding data to derive specific inference which can aid decision making for urban stakeholders.This requires amalgamation of various interdisciplinary techniques. This paper presents a survey of existing technologies in order to investigate the emerging issues surrounding the design of a live knowledge network for sustainable urban living. The maps and models of the existing infrastructure of our cities that include a wealth of information such as topography, layout, zoning, land use, transportation networks, public facilities, and resource network grids need to be integrated with real-time spatiotemporal information about the city. Public data in forms of archives and data streams as well as online data from the social network and the Web can be analyzed using data mining techniques. The domain experts need to interpret the results of data mining into knowledge that will augment the existing knowledge base and models of our cities. In addition to the analysis of archived and streamed data sources from the built environment, the emerging state-of-the-art Web 2.0 and mobile technologies are presented as the potential techniques to crowddesign a live urban knowledge network. Data modeling, data mining, crowdsourcing, and social intervention techniques are reviewed in this paper with examples from the related work and our own experiments.

The escalating threat of fraud in financial institutions is a global issue, with the Malaysian sector being no exception. This study focuses on the implementation and efficacy of Data Mining and Machine Learning methodologies in identifying and mitigating fraudulent activities within these institutions. The paper critically reviews existing literature, bridging the gap between advanced technology application and fraud management. Fraudulent transactions in the financial sector are dynamic and sophisticated, requiring advanced detection techniques. Traditional approaches often struggle to manage this complexity effectively, demonstrating a need for more advanced and adaptive strategies. This is where Data Mining and Machine Learning techniques, renowned for their predictive and analytical prowess, can significantly contribute. Data Mining, the process of uncovering patterns and correlations within large datasets, is a useful tool for detecting anomalies that may suggest fraud. The study assesses various data mining techniques, such as clustering, classification, and association, and explores their application in detecting fraudulent transactions. Findings indicate that these techniques can substantially enhance fraud detection rates while minimizing false positives. Furthermore, Machine Learning, an artificial intelligence subset, has shown immense potential in fraud detection. Its ability to learn from and make decisions based on data makes it a viable solution for fraud detection. This paper explores both supervised and unsupervised learning algorithms and their efficacy in identifying fraud in the Malaysian financial sector. Results suggest that machine learning models, when correctly implemented, can significantly improve the accuracy of fraud detection. The review underscores the importance of employing advanced technologies like Data Mining and Machine Learning to combat financial fraud effectively. It also suggests future research directions, emphasizing the need for context-specific, localized models considering Malaysia's unique socio-economic environment. Moreover, the development of hybrid models, integrating both data mining and machine learning, could offer improved results. In conclusion, this study sets a precedent for further exploration into the application of advanced analytical tools in fraud detection in the Malaysian financial sector. The potential these technologies offer for improving accuracy and adaptability in fraud detection systems is substantial and warrants thorough investigation. Keywords: Fraud Detection, Malaysian Financial Institutions, Data Mining, Machine Learning, Financial Fraud Management

Data mining and machine learning techniques can be applied to computer system design to aid in optimizing design decisions, improving system runtime performance. Data mining techniques have been investigated in the context of branch prediction. Specifically, a comparison of traditional branch predictor performance has been made to data mining algorithms. Additionally, the possiblity of whether additional features available within the architectural state might serve to further improve branch prediction has been evaluated. Results show that data mining techniques indicate potential for improved branch prediction, especially when register file contents are included as a feature set.

Metabolic syndrome (MS) is a condition associated with metabolic abnormalities that are characterized by central obesity (e.g. waist circumference or body mass index), hypertension (e.g. systolic or diastolic blood pressure), hyperglycemia (e.g. fasting plasma glucose) and dyslipidemia (e.g. triglyceride and high-density lipoprotein cholesterol). It is also associated with the development of diabetes mellitus (DM) type 2 and cardiovascular disease (CVD). Therefore, the rapid identification of MS is required to prevent the occurrence of such diseases. Herein, we review the utilization of data mining approaches for MS identification. Furthermore, the concept of quantitative population-health relationship (QPHR) is also presented, which can be defined as the elucidation/understanding of the relationship that exists between health parameters and health status. The QPHR modeling uses data mining techniques such as artificial neural network (ANN), support vector machine (SVM), principal component analysis (PCA), decision tree (DT), random forest (RF) and association analysis (AA) for modeling and construction of predictive models for MS characterization. The DT method has been found to outperform other data mining techniques in the identification of MS status. Moreover, the AA technique has proved useful in the discovery of in-depth as well as frequently occurring health parameters that can be used for revealing the rules of MS development. This review presents the potential benefits on the applications of data mining as a rapid identification tool for classifying MS.

Cardiac arrest is a potentially fatal loss of heart function that occurs suddenly and without warning. Predicting cardiac arrest early could increase the likelihood of survival and allow for prompt treatment. The discipline of computer science known as “datamining” focuses on the process of gleaning useful information from massive databases. Algorithms for data mining can be used to look for trends in records that can indicate a cardiac arrest. Patients at high risk of cardiac arrest due to their medical history, lifestyle choices, or other variables can be pinpointed, for instance, with the help of data mining algorithms. Prediction of cardiac arrest using data mining techniques is discussed in this research. The chapter talks about the many data mining methods that have been employed for this, and the studies that have evaluated their efficacy. The chapter also covers the difficulties of employing data mining for early prediction of cardiac arrest, as well as potential future research avenues.

Used by corporations, industry, and government to inform and fuel everything from focused advertising to homeland security, data mining can be a very useful tool across a wide range of applications. Unfortunately, most books on the subject are designed for the computer scientist and statistical illuminati and leave the reader largely adrift in technical waters. Revealing the lessons known to the seasoned expert, yet rarely written down for the uninitiated, Practical Data Mining explains the ins-and-outs of the detection, characterization, and exploitation of actionable patterns in data. This working field manual outlines the what, when, why, and how of data mining and offers an easy-to-follow, six-step spiral process. Catering to IT consultants, professional data analysts, and sophisticated data owners, this systematic, yet informal treatment will help readers answer questions, such as: What process model should I use to plan and execute a data mining project? How is a quantitative business case developed and assessed? What are the skills needed for different data mining projects? How do I track and evaluate data mining projects? How do I choose the best data mining techniques? Helping you avoid common mistakes, the book describes specific genres of data mining practice. Most chapters contain one or more case studies with detailed projects descriptions, methods used, challenges encountered, and results obtained. The book includes working checklists for each phase of the data mining process. Your passport to successful technical and planning discussions with management, senior scientists, and customers, these checklists lay out the right questions to ask and the right points to make from an insiders point of view. Visit the books webpage for access to additional resourcesincluding checklists, figures, PowerPoint slides, and a small set of simple prototype data mining tools. http://www.celestech.com/PracticalDataMining

In the evolving landscape of financial markets, the convergence of data mining, cybersecurity, and algorithmic trading plays a pivotal role in enhancing trading performance and forensic investigations. This study investigates how data mining techniques are leveraged to extract meaningful patterns and trends from vast financial datasets, improving the accuracy and profitability of algorithmic trading strategies. By identifying historical trends, price movements, and trade margins, data mining enables traders to optimize decision-making processes and manage risks more effectively. Cybersecurity emerges as a critical factor in safeguarding both trading algorithms and sensitive financial data from cyber threats. The integration of advanced cybersecurity measures ensures the integrity, confidentiality, and availability of trading systems, reducing vulnerabilities that could be exploited by malicious actors. Additionally, forensic investigation techniques are employed to detect fraudulent trading activities, such as insider trading and market manipulation, thereby protecting market participants and maintaining regulatory compliance. This research highlights the importance of combining secure data mining practices with robust cybersecurity measures to enhance the overall performance of algorithmic trading systems. Furthermore, it explores how forensic methodologies can help detect anomalies and ensure the transparency and fairness of financial markets. Through an integrated approach, this study emphasizes the potential of data mining and cybersecurity in transforming trading operations while mitigating risks associated with cyber threats and financial fraud.

Big data analysis is essential for modern applications in areas such as healthcare, assistive technology, intelligent transportation, environment and climate monitoring. Traditional algorithms in data mining and machine learning do not scale well with data size. Mining and learning from big data need time and memory efficient techniques, albeit the cost of possible loss in accuracy. We have developed a data aggregation structure to summarize data with large number of instances and data generated from multiple data sources. Data are aggregated at multiple resolutions and resolution provides a trade-off between efficiency and accuracy. The structure is built once, updated incrementally, and serves as a common data input for multiple mining and learning algorithms. Data mining algorithms are modified to accept the aggregated data as input. Hierarchical data aggregation serves as a paradigm under which novel data representations and algorithms work together for analysis and mining of big data. To evaluate its performance, we have implemented a multi-resolution Naive Bayes Classifier on the data aggregation structure. Experimental results show that the proposed structure helps the classifier to reduce computation time to 25% on average and reduce the memory usage while preserving the accuracy of results.