Knowledge discovery and data mining for enhanced sustainability of physical ecosystems

In recent years both the number and the size of organisational databases have increased rapidly. However, although available processing power has also grown, the increase in stored data has not necessarily led to a corresponding increase in useful information and knowledge. This has led to a growing interest in the development of tools capable of harnessing the increased processing power available to better utilise the potential of stored data. The terms Knowledge Discovery in Databases and Mining have been adopted for a field of research dealing with the automatic discovery of knowledge implicit within databases. Data mining is useful in situations where the volume of data is either too large or too complicated for manual processing or, to a lesser extent, where human experts are unavailable to provide knowledge. The success already attained by a wide range of data mining applications has continued to prompt further investigation into alternative data mining techniques and the extension of data mining to new domains. This paper surveys, from the standpoint of the database systems community, current issues in data mining research by examining the architectural and process models adopted by knowledge discovery systems, the different types of discovered knowledge, the way knowledge discovery systems operate on different data types, various techniques for knowledge discovery and the ways in which discovered knowledge is used.

Waste container weighing data processing to create reliable information of household waste generation

The data mining has been performed for the aerodynamic design optimization result of two-stage-to-orbit reusable launch vehicle flyback booster wing. Three data mining techniques were used such as self-organizing map, functional analysis of variance, and rough set theory. The optimization problem had four aerodynamic objective functions and 71 design variables regarding wing shape. The optimization obtained the result as the hypothetical design database with 302 all solutions including the 102 non-dominated solutions. Consequently, the knowledge in the design space was acquired regarding the correlation between objective functions, and the influence of the design variables to the objective function, for non-dominated and all evaluated solutions, respectively. The features of three data mining techniques were revealed. Although the combination among three techniques discovered detailed design knowledge, self-organizing map was especially a key technique for knowledge discovery. Moreover, design knowledge from all solutions conserved the information from non-dominated solutions. Data mining was essential to solve multi-objective optimization problem.

The thriving medical applications of data mining in the fields of medicine and public health has led to the popularity of its use in knowledge discovery in databases (KDD). Data mining has revealed novel biomedical and healthcare acquaintances for clinical decision making that has great potential to improve the treatment quality of hospitals and increase the survival rate of patients. Disease diagnosis is one of the applications where data mining tools are establishing the successful results. Data mining intends to endow with a systematic survey of current techniques of knowledge discovery in databases using data mining techniques that are in use in today’s medical research. Discussion is made to enable the disease diagnosis and the breakthrough of hidden healthcare patterns from related databases is offered. Also, the use of data mining to discover such relationships as those between health conditions and a disease is presented. It further discusses about the tools that can be used for the processing and classification of data. This paper summarizes various technical articles on medical diagnosis and prognosis. It has also been focused on current research being carried out using the data mining techniques to enhance the disease(s) forecasting process. This research paper provides future trends of current techniques of KDD, using data mining tools for healthcare. It also confers significant issues and challenges associated with data mining and healthcare in general. The research found a growing number of data mining applications, including analysis of health care centers for better health policy-making, detection of disease outbreaks and preventable hospital deaths. The root causes of all diseases get closer towards drugs i.e. the foremost risk factor of all hilarious diseases. Drug addiction using WEKA has been used that brings into light concerning majority of drug abusers started abusing drugs at age below 20yrs.It is to make aware the druggist about the various diseases that are caused with heavy or long term intake of drugs in their life. So, to make an expert system that will awake the youth about precarious use of drugs and also alert the affected person.

Data mining and knowledge discovery techniques have greatly progressed in the last decade. They are now able to handle larger and larger datasets, process heterogeneous information, integrate complex metadata, and extract and visualize new knowledge. Often these advances were driven by new challenges arising from real-world domains, with biology and biotechnology a prime source of diverse and hard (e.g., high volume, high throughput, high variety, and high noise) data analytics problems. The aim of this article is to show the broad spectrum of data mining tasks and challenges present in biological data, and how these challenges have driven us over the years to design new data mining and knowledge discovery procedures for biodata. This is illustrated with the help of two kinds of case studies. The first kind is focused on the field of protein structure prediction, where we have contributed in several areas: by designing, through regression, functions that can distinguish between good and bad models of a protein's predicted structure; by creating new measures to characterize aspects of a protein's structure associated with individual positions in a protein's sequence, measures containing information that might be useful for protein structure prediction; and by creating accurate estimators of these structural aspects. The second kind of case study is focused on omics data analytics, a class of biological data characterized for having extremely high dimensionalities. Our methods were able not only to generate very accurate classification models, but also to discover new biological knowledge that was later ratified by experimentalists. Finally, we describe several strategies to tightly integrate knowledge extraction and data mining in order to create a new class of biodata mining algorithms that can natively embrace the complexity of biological data, efficiently generate accurate information in the form of classification/regression models, and extract valuable new knowledge. Thus, a complete data-to-information-to-knowledge pipeline is presented.

In recent years, the exponential growth of both structured and unstructured data has highlighted the importance of efficient knowledge discovery techniques. Among these, image mining and data mining play pivotal roles in extracting meaningful patterns and insights from different forms of information. At the same time, data mining focuses on structured datasets such as databases and transaction records, while image mining deals with unstructured visual content, requiring advanced feature extraction, pattern recognition, and machine learning methods. This paper presents a comparative analysis of image mining and data mining techniques, emphasising their methodologies, applications, and challenges. The comparison explores key dimensions, including data preprocessing, feature selection, algorithmic approaches, and application domains such as healthcare, security, business intelligence, and multimedia. Experimental results show clustering accuracy of 87% for data mining and image classification accuracy of 92% for image mining, highlighting the effectiveness of specialised approaches. The study highlights both the similarities and differences in knowledge discovery processes, demonstrating how integrating image mining and data mining can enhance decision-making in diverse fields. The findings provide a comprehensive understanding of their complementary roles, offering valuable insights for researchers and practitioners aiming to develop hybrid approaches to knowledge discovery.

Decision analysis and optimization are examples of inverse management problems which can be effectively handled by means of Artificial Intelligence (AT) and simulation techniques. However, the application of these techniques in specific industrial contexts finds major constraints in the lack of formalized methodologies and systematic procedures to retrieve and handle the data required for their implementation. The paper proposes Knowledge Discovery (KD) techniques as means of data pre-processing for the development of Al-based decision support systems (DSSs). This use of Knowledge Discovery techniques is illustrated in relation to the design of a hybrid DSS - combining AI and simulation techniques - for the management of maintenance services in the public transport sector.

Could Not Duplicates (CNDs) are the bane of modern aircraft. Inflight Built-in-Test (BIT) or pilot squawks often indicate faults that can not be duplicated with ground testing. For many subsystems CND rates run over 50 percent. The Vehicle Systems Technology (VST) group at the Boeing Company is developing an onboard diagnostic system architecture and supporting technologies to reduce CNDs and exploit the promise of prognostics. The approach involves the use of neural network and fuzzy logic models of subsystem health, correlation of health incidents with operational context and fusion of health reports within and across subsystems. Knowledge Discovery and data mining techniques are used to identify health/fault signatures and develop diagnostic/prognostic models from these signatures. This work was sponsored by Boeing internal research, the Navy through the On-line Flight Control Diagnostic System program (with Lockheed-Martin Control Systems as a subcontractor) and the Joint Strike Fighter technology maturation program.

Pattern mining algorithms for data streams using itemset

The increasing use of computers in all the areas of human activities is resulting in huge collections of digital data. Databases are common everywhere and are used as repositories of every kind of data. Knowledge discovery techniques and tools are used today to analyze those very large data sets to identify interesting patterns and trends in them. When data is maintained over geographically distributed sites the computational power of distributed and parallel systems can be exploited for knowledge discovery in databases. In this scenario the Grid can provide an effective computational support for distributed knowledge discovery on large data sets. To this purpose we designed a system called Knowledge Grid This chapter describes the Knowledge Grid architecture and discusses some related systems and models recently proposed for knowledge discovery on Grids. The chapter presents also how to design and implement distributed data mining applications by using the Knowledge Grid tools starting from searching Grid resources, composing software and data elements, and executing the resulting application on a Grid.

Knowledge discovery in financial organization have been built and operated mainly to support decision making using knowledge as strategic factor. In this paper, we investigate the use of various data mining techniques for knowledge discovery in insurance business. Existing software are inefficient in showing such data characteristics. We introduce different exhibits for discovering knowledge in the form of association rules, clustering, classification and correlation suitable for data characteristics. Proposed data mining techniques, the decision- maker can define the expansion of insurance activities to empower the different forces in existing life insurance sector.

Analysing datasets using data mining techniques can enhance decision making in organizations. However, to ensure that the full potential of these techniques is realised it is important that decision makers understand there are Knowledge Discovery and Data Mining (KDDM) processes that are mature enough to be adopted. This paper demonstrates the benefits of using a KDDM process to evaluate survey data for internet banking users in Jamaica which includes demographic as well as attitudinal and behavioral variables. The major benefits of following this process include the selection of a set of models, rather than a single model, which are more relevant to the business/research objectives and use of a more targeted knowledge discovery process as the data mining analyst is now directed to consider the effects the decisions in each phase will have on subsequent phases. This leads to more relevant knowledge being extracted from the data mining process.

This chapter is interested in discussing how to use data mining techniques to assist in achieving an acceptable level of quality of service of telecommunication systems. The quality of service is defined as the metrics which are predicated by using the data mining techniques, decision tree, association rules and neural networks. Routing algorithms can use this metric for optimal path selection which in turn will affect positively on the system performance. Also, in this chapter management axis using data mining techniques were handled, i.e., check the status of the telecommunication networks, role of data mining in obtaining optimal configuration, how to use data mining technique to assure high level of security for the telecommunication. The popularity of data mining in the telecommunications industry can be viewed as an extension of the use of expert systems in the telecommunications industry. These systems were developed to address the complexity associated with maintaining a huge network infrastructure and the need to maximize network reliability while minimizing labor costs (Liebowitz, J. 1988). The problem with these expert systems is that they are expensive to develop because it is both difficult and time consuming to elicit the requisite domain knowledge from experts.

This paper describes an approach to identify the state of a power system using Data Mining Algorithms. With the advent of Phasor Measurement Units (PMU), a huge amount of power system data is being stored day-to-day in the Phasor Data Collectors (PDCs). Knowledge discovery and machine learning techniques can make use of this data to extract valuable information and interesting patterns in these databases. In this paper, Symbolic Aggregate ApproXimation (SAX) is used to convert the time stamped phasor data from the PMUs into symbolic strings and Data Mining (DM) algorithms are used to predict the current state of a power system. Along with the state, the location and cause of disturbance is also identified in minimal time. The effectiveness of different DM algorithms for determining state of a power system is also shown using the measures of accuracy, precision and recall.

In this paper, we give an overview of knowledge discovery (KD) and information extraction (IE) techniques on the World Wide Web (WWW). We intend to answer the following questions: What kind of additional uncertainty challenges are introduced by the WWW setting to basic KD and IE techniques? What are the fundamental techniques that can be used to reduce such uncertainty and achieve reasonable KD and IE performance on the WWW? What is the impact of each novel method? What types of interactions can be conducted between these techniques and information networks to make them benefit from each other? In what way can we utilize the results in more interesting applications? What are the remaining challenges and what are the possible ways to address these challenges? We hope this can provide a road map to advance KD and IE on the WWW to a higher level of performance, portability and utilization.