Data Mining and Medical Research Studies

Data Mining refers to a set of methods applicable to large and complex databases to eliminate the randomness and discover the hidden pattern. Datamining (DM), also known as knowledge discovery from databases (KDD), is the extraction of new knowledge from huge databases. Data mining involves the use of sophisticated data analysis tools to discover previously unknown, valid patterns and relationships in large data sets. Data mining tools can forecast the future trends and activities to support the decision of people. The scope of datamining is associated with Uncovering trends and patterns are a great power for the businesses of all sectors and industries. Modern intrusion detection applications are confronted with a variety of issues. These applications must be reliable, extensible, manageable, and minimal in maintenance costs. Data mining-based intrusion detection systems (IDSs) have shown high accuracy, good generalisation to novel types of intrusion, and stable behaviour in a changing environment in recent years. The number of hidden layers in various neural network topologies is evaluated in order to discover the best neural network. The technique of attempting to discover instances of network attacks by comparing current behaviour to the expected actions of an intruder is known as misuse detection. Artificial neural networks have the ability to detect and classify network activity using data that is limited, incomplete, and nonlinear. The main purpose of this work is to identify privacy and security concerns among cloud computing participants and consumers in a distributed environment. Techniques like Machine Learning, Natural Language Processing (NLP), and Data Mining are combined to automatically identify and uncover patterns from many sorts of materials. Predictive analytics is capable of dealing with both continuous and discontinuous changes. Classification, prediction, and to some extent, affinity analysis constitute the analytical methods employed in predictive analytics. The contemporary study in text or document mining is focusing on syntactic components and the semantic environment. In order to accomplish this, and with the motivation gained from our previous research contributions, we investigated a mining model to classify documents based on the Order of Context, Concept, and Semantic Relations (OCCSR). The use of data mining techniques based on Cloud computing will enable users to retrieve meaningful information from virtually integrated data warehouses, lowering infrastructure and storage costs. Data mining can extract useful and potentially useful information from the cloud. Big Data is typically defined by three characteristics known as the 3Vs (Volume, Velocity and Variety). The surveys approaches, environments, and technologies in key areas for Big Data analytics capabilities and discusses how they aid in the development of analytics solutions for Clouds. The clustering technique belongs to an unsupervised learning and it is used to discover a new set of categories. Grid-based clustering has the shortest processing time, which is typically determined by the size of the grid rather than the data. We compare the performance of three clustering algorithms: hierarchical clustering, density-based clustering, and K Means clustering. The majority of current approaches to detecting misuse involve the use of rule-based expert systems to identify indicators of known attacks. We provide a brief overview of the use of various Artificial Intelligence techniques and their advancements in the design, development, and application of Intrusion Detection Systems (IDS) for protecting computer and communication networks from intruders. The goal of Knowledge Discovery in Data (KDD) is to extract information that is not obvious by using careful and detailed analysis and interpretation. To drive decisions and actions, analytics employs KDD, data mining, text mining, statistical and quantitative analysis, explanatory and predictive models, and advanced and interactive visualisation techniques.

Data mining, often also called knowledge discovery in database (KDD), is an activity that includes collecting, using historical data to find order, patterns or relationships in large data sets. Outputs from data mining can be used to improve future decision making. Problems that often occur in BPDASHL are estimation problems such as weather, difficulties in planting, lack of labor, lack of experience in tree nurseries, and different soil conditions. Another problem that is found in agencies is that they do not have a system to predict estimated tree seedlings orders every year so that a method is needed, namely the Multiple Linear Regression Algorithm. So with this was made the Application of Data Mining To Predict Ordering Tree Seeds With Multiple Linear Regression. Multiple Linear Regression Algorithms which are methods that support estimating or predicting order targets for the coming period. Algorithm testing is done using SPSS software. From the results of the research that has been done, it can help BPDASHL to make it easier to predict the ordering of seeds using SPSS Software

Self-reported data and/or medical records are often used to assess the prevalence of illness and impairment in epidemiological studies. However, these two data sources do not always provide the same information. The aim was to compare data from interviews and medical records regarding illness, symptoms and impairment in the elderly, and to analyze the agreement between a consensus from both data sources and data from interviews and medical records, respectively. We interviewed 130 persons (age range 67-99) regarding socio-demographic background data and physical and mental health. Medical records were reviewed. Illness burden was rated according to the Cumulative Illness Rating Scale for Geriatrics, and was rated in three ways based on: (1) interview data; (2) medical records; (3) information from both interviews and medical records considered to be consensus. Agreement was measured by the Kappa coefficient and the Svensson Paired Rank Measurement. A permutation test tested whether the ratings from interviews and medical records had the same agreement when compared with consensus. Statistically significant differences in agreement were found between interview versus consensus and medical records versus consensus for the vascular system (medical records best), eyes/ears/nose/throat/larynx and musculoskeletal/integument (interview best). Medical records gave better in formation concerning specific diseases and diagnoses, whereas interview data provided a better measure of illness, functional impairment and health in a broader sense. Both medical records and interviews yield good information of elderly people's health status, but they focus on different aspects of health.

Data mining (DM) research has successfully developed advanced DM techniques and algorithms over the last few decades, and many organisations have great expectations to take more benefit of their data warehouses in decision making. Currently, the strong focus of most DM-researchers is still only on technology-oriented topics. Commonly the DM research has several stakeholders, the major of which can be divided into internal and external ones each having their own point of view, and which are at least partly conflicting. The most important internal groups of stakeholders are the DM research community and academics in other disciplines. The most important external stakeholder groups are managers and domain experts who have their own utility-based interests to DM and DM research results. In this paper we discuss these practice-oriented points of view towards DM research and suggest broader discussions inside the DM research community about who should do that kind of research. We bring in the discussion several topics developed in the information systems (IS) discipline and show some similarities between IS and DM systems. DM systems have also their own peculiarities and we conclude that researchers who take into account human and organisational aspects related to DM systems need to have also some understanding about DM. This makes us suggest that the research area inside the DM community should be made broader than the current heavily technology-oriented one.

Data mining is one of the most important steps of the knowledge discovery in databases process and is considered as significant subfield in knowledge management. Research in data mining continues growing in business and in learning organization over coming decades. This review paper explores the applications of data mining techniques which have been developed to support knowledge management process. The journal articles indexed in ScienceDirect Database from 2007 to 2012 are analyzed and classified. The discussion on the findings is divided into 4 topics: (i) knowledge resource; (ii) knowledge types and/or knowledge datasets; (iii) data mining tasks; and (iv) data mining techniques and applications used in knowledge management. The article first briefly describes the definition of data mining and data mining functionality. Then the knowledge management rationale and major knowledge management tools integrated in knowledge management cycle are described. Finally, the applications of data mining techniques in the process of knowledge management are summarized and discussed.

Sentiment analysis has been rapidly employed for business decision support. New data mining researchers are yet to have an adequate understanding of the various applications of sentiment analysis while utilising social media data. As a result, it is critical to define the data mining and text analytics research trend holistically using existing literature. The study explores sentiment analysis research for its application in transforming social media data and identifies relevant research aspects through a comprehensive bibliometric review of 523 research articles published in the Scopus database (between 2018 and 2022) to discern the content and thematic analysis. Findings suggested that key purposes of the sentiment analysis are mainly related to innovation, transparency, and efficiency. Our review also highlights the distinctiveness of sentiment analysis for synthesising social media information to investigate various features, including the knowledge-domain map that detects author collaboration networks in the past.

The Outlier detection is very active area of research in data mining where outlier is a mismatched data in dataset with respect to the other available data.In existing approaches the outlier detection done only on numeric dataset.For outlier detection if we use clustering method , then they mainly focus on those elements as outliers which are lying outside the clusters but it may possible that some of the unknown elements with any possible reasons became the part of the cluster so we have to concentrate on that also.The Proposed method uses hybrid approach to reduce the number of outliers.The number of outlier can only reduce by improving the cluster formulation method.The proposed method uses two data mining techniques for cluster formulation i.e. weighted k-means and neural network where weighted kmeans is the clustering technique that can apply on text and date data set as well as numeric data set.Weighted kmeans assign the weights to each element in dataset.The output of weighted k-means becomes the input for neural network where the neural network is the classification and clustering technique of data mining.Training is provided to the neural network and according to that neurons performed the testing.The neural network test the cluster formulated by weighted k-means to ensure that the clusters formulated by weighted k-means are group accordingly.There is lots of outlier detection methods present in data mining.The proposed method use Integrating Semantic Knowledge (SOF) for outlier detection.This method detects the semantic outlier where the semantic outlier is a data point that behaves differently with other data points in the same class or cluster.The main motive of this research work is to reduce the number of outliers by improving the cluster formulation methods so that outlier rate reduces and also to decrease the mean square error and improve the accuracy.The simulation result clearly shows that proposed method works pretty well as it significantly reduces the outlier.

The thriving medical applications of data mining in the fields of medicine and public health has led to the popularity of its use in knowledge discovery in databases (KDD). Data mining has revealed novel biomedical and healthcare acquaintances for clinical decision making that has great potential to improve the treatment quality of hospitals and increase the survival rate of patients. Disease diagnosis is one of the applications where data mining tools are establishing the successful results. Data mining intends to endow with a systematic survey of current techniques of knowledge discovery in databases using data mining techniques that are in use in today’s medical research. Discussion is made to enable the disease diagnosis and the breakthrough of hidden healthcare patterns from related databases is offered. Also, the use of data mining to discover such relationships as those between health conditions and a disease is presented. It further discusses about the tools that can be used for the processing and classification of data. This paper summarizes various technical articles on medical diagnosis and prognosis. It has also been focused on current research being carried out using the data mining techniques to enhance the disease(s) forecasting process. This research paper provides future trends of current techniques of KDD, using data mining tools for healthcare. It also confers significant issues and challenges associated with data mining and healthcare in general. The research found a growing number of data mining applications, including analysis of health care centers for better health policy-making, detection of disease outbreaks and preventable hospital deaths. The root causes of all diseases get closer towards drugs i.e. the foremost risk factor of all hilarious diseases. Drug addiction using WEKA has been used that brings into light concerning majority of drug abusers started abusing drugs at age below 20yrs.It is to make aware the druggist about the various diseases that are caused with heavy or long term intake of drugs in their life. So, to make an expert system that will awake the youth about precarious use of drugs and also alert the affected person.

Basically, Data Mining (DM) and Operations Research (OR) are two paradigms independent of each other. OR aims at optimal solutions of decision problems with respect to a given goal. DM is concerned with secondary analysis of large amounts of data (Hand et al., 2001). However, there are some commonalities. Both paradigms are application focused (Wu et al., 2003; White, 1991). Many Data Mining approaches are within traditional OR domains like logistics, manufacturing, health care or finance. Further, both DM and OR are multidisciplinary. Since its origins, OR has been relying on fields such as mathematics, statistics, economics and computer science. In DM, most of the current textbooks show a strong bias towards one of its founding disciplines, like database management, machine learning or statistics. Being multidisciplinary and application focused, it seems to be a natural step for both paradigms to gain synergies from integration. Thus, recently an increasing number of publications of successful approaches at the intersection of DM and OR can be observed. On the one hand, efficiency of the DM process is increased by use of advanced optimization models and methods originating from OR. On the other hand, effectiveness of decision making is increased by augmentation of traditional OR approaches with DM results. Meisel and Mattfeld (in press) provide a detailed discussion of the synergies of DM and OR.

Evidence-based medicine is an important initiative of the U.S. National Institutes of Health. However, published data are limited. Medical knowledge can be advanced through pharmacoepidemiology and data mining research of very large databases, data warehouses. Before Vioxx (rofecoxib) and Celebrex (celecoxib) were publicly suspected of being associated with acute myocardial infarction and stroke, etodolac was evaluated for gastrointestinal safety using a data warehouse constructed from several data sources and data mining tools embedded with pharmacoepidemiologic methods. Results were published in a top tier medical journal, and established gastrointestinal safety of a generic COX-2 analgesic medication. This project demonstrates that the knowledge needed for evidence-based medicine can be augmented through pharmacoepidemiology research using data mining and data warehousing.

Noting that several rule discovery algorithms in data mining can produce a large number of irrelevant or obvious rules from data, there has been substantial research in data mining that addressed the issue of what makes rules truly 'interesting'. This resulted in the development of a number of interestingness measures and algorithms that find all interesting rules from data. However, these approaches have the drawback that many of the discovered rules, while supposed to be interesting by definition, may actually (1) be obvious in that they logically follow from other discovered rules or (2) be expected given some of the other discovered rules and some simple distributional assumptions. In this paper we argue that this is a paradox since rules that are supposed to be interesting, in reality are uninteresting for the above reason. We show that this paradox exists for various popular interestingness measures and present an abstract characterization of an approach to alleviate the paradox. We finally discuss existing work in data mining that addresses this issue and show how these approaches can be viewed with respect to the characterization presented here.

With the huge amount of information available online, the World Wide Web is a fertile area for data mining research. The data mining research is at the cross road of research from several research communities, such as database, information retrieval, and within AI, especially the sub-areas of machine learning and data integrity. Every E-commerce and social website in World Wide Web uses the Classification is one of the data mining problems receiving great attention recently in the database community. Neural network is not suitable for data mining directly, because how the classifications were made is not explicitly stated as symbolic rules that are suitable for verification or interpretation by humans. Different concise symbolic rules with high accuracy can be extracted from a neural network with the proposed approach. The neural network is first trained to achieve the required accuracy in data mining. In this paper we are going to combine neural network with the three different algorithms which are commonly used in data mining to improve the data mining result. These three algorithms are CHARM Algorithm, Top K Rules mining and CM SPAM Algorithm. The different datasets of online e-commerce website filpkart and Amazon are used to train the neural network and to use in data mining. The results of all three data mining algorithm with neural network techniques then tested on the available datasets and result are compared by computational complexity of the algorithm.

People's health status is related to disease control, personal health, etc., so more attention has been paid on it. Stepping into era of Internet of Things (IoT), because of the emerging of all kinds of intelligent devices and prevalence of social media, people's health data can be accessed more easily. In this paper, a framework for analyzing regional group health persona is designed. And a prototype system is implemented. In addition, we did an experiment and collected vital individual health information from the participants' smart device and environment data from their social networks. Specifically, we use deep learning method to recognize and label their food image to measure their dietary status, and then classify them into groups by clustering their individual data with these dietary data. And analysis on their social environment is also given.

Cohort studies are the analytical design of observational studies that are epidemiologically used to identify and quantify the relationship between exposure and outcome. Due to the longitudinal design, cohort studies have several advantages over other types of observational studies. The purpose of this chapter is to cover the various characteristics of prospective cohort studies. This chapter is divided into three main sections. In the first we introduce the concept and ranking of cohort studies, as well as the advantages and disadvantages. In the second we focus on the design of cohort studies, mainly its prospective aspect, and the distinguishing features from the retrospective type. The section also covers the essential characteristics of a cohort study design and its varied applications in medical research. In the third we go over examples of prospective studies in the medical field. For each, an overview of the study design is given, along with a random selection of study findings/impact, strengths and weaknesses.

Data mining research is extensive, but most work has proposed efficient algorithms, data structures and optimizations that work outside a DBMS, mostly on flat files. In contrast, we present a data mining system that can work on top of a relational DBMS based on a combination of SQL queries and User-Defined Functions (UDFs), debuking the common perception that SQL is inefficient or inadequate for data mining. We show our system can analyze large data sets significantly faster than external data mining tools. Moreover, our UDF-based algorithms can process a data set in one pass and have linear scalability.