Data Mining Techniques in Analyzing Process Data: A Didactic.

Landslide susceptibility and building exposure assessment using machine learning models and geospatial analysis techniques

Savannah grazing lawns are a key food resource for large herbivores such as blue wildebeest (Connochaetes taurinus), hippopotamus (Hippopotamus amphibius) and white rhino (Ceratotherium simum), and impact herbivore densities, movement and recruitment rates. They also exert a strong influence on fire behaviour including frequency, intensity and spread. Thus, variation in grazing lawn cover can have a profound impact on broader savannah ecosystem dynamics. However, knowledge of their present cover and distribution is limited. Importantly, we lack a robust, broad-scale approach for detecting and monitoring grazing lawns, which is critical to enhancing understanding of the ecology of these vital grassland systems. We selected two sites in the Lower Sabie and Satara regions of Kruger National Park, South Africa with mesic and semiarid conditions, respectively. Using spectral and texture features derived from WorldView-3 imagery, we (i) parameterised and assessed the quality of Random Forest (RF), Support Vector Machines (SVM), Classification and Regression Trees (CART) and Multilayer Perceptron (MLP) models for general discrimination of plant functional types (PFTs) within a sub-area of the Lower Sabie landscape, and (ii) compared model performance for probabilistic mapping of grazing lawns in the broader Lower Sabie and Satara landscapes. Further, we used spatial metrics to analyse spatial patterns in grazing lawn distribution in both landscapes along a gradient of distance from waterbodies. All machine learning models achieved high F-scores (F1) and overall accuracy (OA) scores in general savannah PFTs classification, with RF (F1 = 95.73±0.004%, OA = 94.16±0.004%), SVM (F1 = 95.64±0.002%, OA = 94.02±0.002%) and MLP (F1 = 95.71±0.003%, OA = 94.27±0.003%) forming a cluster of the better performing models and marginally outperforming CART (F1 = 92.74±0.006%, OA = 90.93±0.003%). Grazing lawn detection accuracy followed a similar trend within the Lower Sabie landscape, with RF, SVM, MLP and CART achieving F-scores of 0.89, 0.93, 0.94 and 0.81, respectively. Transferring models to the Satara landscape however resulted in relatively lower but high grazing lawn detection accuracies across models (RF = 0.87, SVM = 0.88, MLP = 0.85 and CART = 0.75). Results from spatial pattern analysis revealed a relatively higher proportion of grazing lawn cover under semiarid savannah conditions (Satara) compared to the mesic savannah landscape (Lower Sabie). Additionally, the results show strong negative correlation between grazing lawn spatial structure (fractional cover, patch size and connectivity) and distance from waterbodies, with larger and contiguous grazing lawn patches occurring in close proximity to waterbodies in both landscapes. The proposed machine learning approach provides a novel and robust workflow for accurate and consistent landscape-scale monitoring of grazing lawns, while our findings and research outputs provide timely information critical for understanding habitat heterogeneity in southern African savannahs.

Satellite image classification is crucial in various applications such as urban planning, environmental monitoring, and land use analysis. In this study, the authors present a comparative analysis of different supervised and unsupervised learning methods for satellite image classification, focusing on a case study in Casablanca using Landsat 8 imagery. This research aims to identify the most effective machine-learning approach for accurately classifying land cover in an urban environment. The methodology used consists of the pre-processing of Landsat imagery data from Casablanca city, the authors extract relevant features and partition them into training and test sets, and then use random forest (RF), SVM (support vector machine), classification, and regression tree (CART), gradient tree boost (GTB), decision tree (DT), and minimum distance (MD) algorithms. Through a series of experiments, the authors evaluate the performance of each machine learning method in terms of accuracy, and Kappa coefficient. This work shows that random forest is the best-performing algorithm, with an accuracy of 95.42% and 0.94 Kappa coefficient. The authors discuss the factors of their performance, including data characteristics, accurate selection, and model influencing.

India is ranked 120th among 122 countries globally in WaterAid’s water quality index. Regular water quality monitoring is essential to determine which inland water bodies are experiencing depreciating water quality. Long-term trends have been obtained using satellite remote sensing, necessitating multiple image analysis. The computational burden of processing numerous satellite images can be reduced using Google Earth Engine’s (GEE) cloud computing capabilities. Thorough research was conducted to determine the global spatio-temporal and biochemical factors impacting surface water quality (WQ). The public availability of geospatial datasets and free access to cloud-based geo-computing platforms such as GEE are widely used for spatio-temporal mapping, global surface water monitoring, water quality parametric variation, and real-time forecasting. Many researchers have recently focused on improving data mining and machine learning algorithms to accurately deal with image classification and predictive problems for crop identification and monitoring. In the present study, we propose to define band spectral ratios, spectral band equations, and empirical models for water quality parameters. A few neural network models will be used to (i) query and pre-process satellite earth observations that coincide with the study area, (ii) extract the spectra, and (iii) use spectral band wavelength charts, time-series charts, spatial-distribution maps, and the development of an online dashboard application to visualize the results graphically upon using integrated Landsat (8,9), Sentinel-2A/B and PlanetScope satellite data for the pre-monsoon and post-monsoon seasons in 2023 in the pan-India region. MODIS-TERRA provides LST spatial-temporal monitoring. In this, we have assessed and compared the performance of CART, SVM, and RF ML algorithms. We found that RF outperforms CART and SVM algorithms in the GEE platform with PlanetScope data (80.71% overall accuracy (OA) with Kappa 0.89) and also with the integration of PlanetScope and Sentinel-2A/B data (OA = 85.53%, Kappa 0.91). But CART outperforms RF and SVM algorithms with Sentiel-2A/B data (OA = 81.59%, Kappa 0.85). The SAM technique, spectral feature fitting, continuum band removal, and other band-spectral ratio techniques are employed for quantitative hyperspectral data analysis. Specifically, the performance metrics of XGBoost and SGD for both Chl-a (R^2 = 0.818) and Turbidity (R^2 = 0.815) models exhibited robust accuracy. We have also developed a Google API-based JavaScript code that can be tested under complex coastal shores, challenging inundation and variable climatic conditions. Our method provides the end-to-end cloud computing workflow shown in this research, considering cost and computational efficiency for timely information delivery.Keywords: Classification and Regression Trees (CART), Chlorophyll-a (conc), Color dissolved organic matter (CDOM), Composite water management index (CWMI), Environmental Mapping and Analysis Program (EnMAP), Land Surface Temperature (LST), Machine Learning (ML), Random Forest (RF), Spectral Angle Mapper (SAM), Stochastic Gradient Descent (SGD), Support Vector Machine (SVM), Total Suspended Solids (TSS), Water Quality (WQ), XGBoost (Extreme Gradient Boosting).

Precise rainfall forecasting is a common challenge across the globe in meteorological predictions. As rainfall forecasting involves rather complex dynamic parameters, an increasing demand for novel approaches to improve the forecasting accuracy has heightened. Recently, Rough Set Theory (RST) has attracted a wide variety of scientific applications and is extensively adopted in decision support systems. Although there are several weather prediction techniques in the existing literature, identifying significant input for modelling effective rainfall prediction is not addressed in the present mechanisms. Therefore, this investigation has examined the feasibility of using rough set based feature selection and data mining methods, namely Naive Bayes (NB), Bayesian Logistic Regression (BLR), Multi-Layer Perceptron (MLP), J48, Classification and Regression Tree (CART), Random Forest (RF), and Support Vector Machine (SVM), to forecast rainfall. Feature selection or reduction process is a process of identifying a significant feature subset, in which the generated subset must characterize the information system as a complete feature set. This paper introduces a novel rough set based Maximum Frequency Weighted (MFW) feature reduction technique for finding an effective feature subset for modelling an efficient rainfall forecast system. The experimental analysis and the results indicate substantial improvements of prediction models when trained using the selected feature subset. CART and J48 classifiers have achieved an improved accuracy of 83.42% and 89.72%, respectively. From the experimental study, relative humidity2 (a4) and solar radiation (a6) have been identified as the effective parameters for modelling rainfall prediction. ACM CCS (2012) Classification : Computing methodologies → Machine learning → Machine learning algorithms → Feature selection; Information systems → Information retrieval → Retrieval tasks and goals → Clustering and classification; Applied computing → Operations research → Forecasting *To cite this article: S. Mohankumar and V. Balasubramanian, Identifying Effective Features and Classifiers for Short Term Rainfall Forecast Using Rough Sets Maximum Frequency Weighted Feature Reduction Technique, CIT. Journal of Computing and Information Technology , vol. 24, no. 2, pp. 181–194, 2016.

Smart meter monitoring and data mining techniques for predicting refrigeration system performance

To construct and validate the best predictive model for 28-day death risk in patients with septic shock based on different supervised machine learning algorithms. The patients with septic shock meeting the Sepsis-3 criteria were selected from Medical Information Mart for Intensive Care-IV v2.0 (MIMIC-IV v2.0). According to the principle of random allocation, 70% of these patients were used as the training set, and 30% as the validation set. Relevant predictive variables were extracted from three aspects: demographic characteristics and basic vital signs, serum indicators within 24 hours of intensive care unit (ICU) admission and complications possibly affecting indicators, functional scoring and advanced life support. The predictive efficacy of models constructed using five mainstream machine learning algorithms including decision tree classification and regression tree (CART), random forest (RF), support vector machine (SVM), linear regression (LR), and super learner [SL; combined CART, RF and extreme gradient boosting (XGBoost)] for 28-day death in patients with septic shock was compared, and the best algorithm model was selected. The optimal predictive variables were determined by intersecting the results from LASSO regression, RF, and XGBoost algorithms, and a predictive model was constructed. The predictive efficacy of the model was validated by drawing receiver operator characteristic curve (ROC curve), the accuracy of the model was assessed using calibration curves, and the practicality of the model was verified through decision curve analysis (DCA). A total of 3 295 patients with septic shock were included, with 2 164 surviving and 1 131 dying within 28 days, resulting in a mortality of 34.32%. Of these, 2 307 were in the training set (with 792 deaths within 28 days, a mortality of 34.33%), and 988 in the validation set (with 339 deaths within 28 days, a mortality of 34.31%). Five machine learning models were established based on the training set data. After including variables at three aspects, the area under the ROC curve (AUC) of RF, SVM, and LR machine learning algorithm models for predicting 28-day death in septic shock patients in the validation set was 0.823 [95% confidence interval (95%CI) was 0.795-0.849], 0.823 (95%CI was 0.796-0.849), and 0.810 (95%CI was 0.782-0.838), respectively, which were higher than that of the CART algorithm model (AUC = 0.750, 95%CI was 0.717-0.782) and SL algorithm model (AUC = 0.756, 95%CI was 0.724-0.789). Thus above three algorithm models were determined to be the best algorithm models. After integrating variables from three aspects, 16 optimal predictive variables were identified through intersection by LASSO regression, RF, and XGBoost algorithms, including the highest pH value, the highest albumin (Alb), the highest body temperature, the lowest lactic acid (Lac), the highest Lac, the highest serum creatinine (SCr), the highest Ca2+, the lowest hemoglobin (Hb), the lowest white blood cell count (WBC), age, simplified acute physiology score III (SAPS III), the highest WBC, acute physiology score III (APS III), the lowest Na+, body mass index (BMI), and the shortest activated partial thromboplastin time (APTT) within 24 hours of ICU admission. ROC curve analysis showed that the Logistic regression model constructed with above 16 optimal predictive variables was the best predictive model, with an AUC of 0.806 (95%CI was 0.778-0.835) in the validation set. The calibration curve and DCA curve showed that this model had high accuracy and the highest net benefit could reach 0.3, which was significantly outperforming traditional models based on single functional score [APS III score, SAPS III score, and sequential organ failure assessment (SOFA) score] with AUC (95%CI) of 0.746 (0.715-0.778), 0.765 (0.734-0.796), and 0.625 (0.589-0.661), respectively. The Logistic regression model, constructed using 16 optimal predictive variables including pH value, Alb, body temperature, Lac, SCr, Ca2+, Hb, WBC, SAPS III score, APS III score, Na+, BMI, and APTT, is identified as the best predictive model for the 28-day death risk in patients with septic shock. Its performance is stable, with high discriminative ability and accuracy.

Introduction: No accurate diagnostic tests exist for exocrine pancreatic insufficiency (EPI). As a result, EPI is misdiagnosed, including in chronic pancreatitis (CP), and there is an unmet need for clinical tools to help clinicians evaluate patients with CP at risk for EPI. The aim of this study was to generate a simple clinical tool to predict EPI in patients with CP. Methods: 49 variables from medical records of CP patients with or without EPI were entered into a Classification and Regression Tree (CART) model using the unimputed full analysis set and 4 other models (Logistic Regression with Least Absolute Shrinkage and Selection Operator regularization, Support Vector Machine, Random Forest, and Gradient Boosting Machine) using imputed full analysis set. EPI misclassification rate (mRate) served as primary metric to train the 5 prediction models. Each model’s generalizability was assessed using 5-fold cross-validation and the model that was best suited for clinician use based on mRate and other characteristics was selected. Results: Records of 274 patients with CP from 6 pancreatitis centers across the US were included. Among the 160 (58%)/114 (42%) patients with EPI/without EPI, 48%/55% were female, mean age was 55/52 years, 76%/69% were white, 29%/52% were never smokers, and 39%/53% were never alcohol users. All 5 prediction models demonstrated similar EPI mRates. The CART model was selected. The final CART decision tree includes 10 variables (in order of importance): smoking, pancreatic atrophy, steatorrhea, alcohol use, hemoglobin, serum vitamin D, pancreatic duct contour change, serum albumin, pancreatic parenchymal calcifications, and use of opioid analgesics. The mRate without and with 5-fold cross-validation of the CART was 0.153 (training error) and 0.314 (prediction error), and the area under the receiver operating characteristic curve was 0.889 and 0.682, respectively (Figure 1). Sensitivity/specificity without/with 5-fold cross validation was 0.888/0.789 and 0.794/0.535, respectively. Conclusion: A parsimonious set of 10 variables associated with EPI in CP was identified. The CART decision tree demonstrated good prediction performance for EPI and was selected as the most practical screening tool to aid clinicians in the assessment of EPI in patients with CP. Further external validation of the EPI screening tool is planned.Figure 1.: AUC-ROC of the CART model trained on the full analysis set and after 5-fold cross-validation. AUC, area under the curve; CART, classification and regression tree; CV, cross-validation; ROC, receiver operating characteristic.

Spatial analysis of groundwater flowing artesian condition using machine learning techniques

This research paper focuses on creating a machine learning algorithm-powered artificial intelligence system for heart disease detection. The main goal is to use different machine learning models to predict heart disease in patients. Adaptive Boosting (Adaboost), Classification and Regression Tree (CART), Gradient Boosting Machine (GBM), Support Vector Machine (SVM), K-Nearest Neighbours (KNN), Multilayer Perceptron (MLP), Extra Tree Classifier (ET), Extreme Gradient Boosting (XGB), Sustainable Development Goals (SDG), and Random Forest (RF) are some of these models. This research article attempts to determine the best algorithm for heart disease prediction through a comparison analysis. The results show that XGB outperforms other algorithms in terms of performance, achieving the maximum accuracy of 97.91%.

Smart cities are centres of economic opulence and hope for standardized living. Understanding the shades of urban resilience and livability in smart city models is of paramount importance. This study presents a novel two-stage data-driven framework combining a multivariate metric-distance analysis with machine learning (ML) techniques for resilience and livability assessment of smart cities. A longitudinal dataset for 35 top-ranked European smart cities from 2015 till 2020 applied as the case study under the proposed framework. Initially, a metric distance-based weighting approach is used to weight the indicators and quantify the scores across each aspect under city resilience and urban livability. The key aspects under city resilience include social, economic, infrastructure and built environment and, institutional resilience, while under urban livability, the aspects include accessibility, community well-being, and economic vibrancy. Fuzzy c-means clustering as an unsupervised machine learning technique is used to sort smart cities based on the degree of performance. In addition, an intelligent approach is presented for the prediction of the degree of livability, resilience, and aggregate performance of smart cities based on various supervised ML techniques. Classification models such as Naïve Bayes, k-nearest neighbors (kNN), support vector machine (SVM), Classification and Regression Tree (CART) and, ensemble models including Random Forest (RF) and Gradient Boosting machine (GBM) were used. Three coefficients (accuracy, Cohen's Kappa (κ) and average area under the precision-recall curve (AUC-PR)) along with confusion matrix were used to appraise the performance of the classifier ML models. The results revealed GBM as the best classification and predictive model for the resilience, livability, and aggregate performance assessment. The study also revealed Copenhagen, Geneva, Stockholm, Munich, Helsinki, Vienna, London, Oslo, Zurich, and Amsterdam as the smart cities that co-create resilience and livability in their development model with superior performance.

Single-cell RNA-seq overcomes the shortcomings of conventional transcriptome sequencing technology and could provide a powerful tool for distinguishing the transcriptome characteristics of various cell types in biological tissues, and comprehensively revealing the heterogeneity of gene expression between cells. Many Intelligent Computing methods have been presented to infer gene regulatory network (GRN) with single-cell RNA-seq data. In this paper, we investigate the performances of seven classifiers including support vector machine (SVM), random forest (RF), Naive Bayesian (NB), GBDT, logical regression (LR), decision tree (DT) and K-Nearest Neighbor (KNN) for solving the binary classification problems of GRN inference with single-cell RNA-seq data (Single_cell_GRN). In SVM, three different kernel functions (linear, polynomial and radial basis function) are utilized, respectively. Three real single-cell RNA-seq datasets from mouse and human are utilized. The experiment results prove that in most cases supervised learning methods (SVM, RF, NB, GBDT, LR, DT and KNN) perform better than unsupervised learning method (GENIE3) in terms of AUC. SVM, RF and KNN have the better performances than other four classifiers. In SVM, linear and polynomial kernels are more fit to model single-cell RNA-seq data.

Machine learning approach to predict susceptible growth regions of Moringa peregrina (Forssk)

Non-cognitive factors are considered critical aspects in shaping students' academic achievement. This study aims to analyze and explore the mechanisms of the influence of non-cognitive factors on 15-year-old students' abilities in China and the United States. Based on the Programme for International Student Assessment (PISA) 2018 education dataset, the Classification and Regression Tree (CART) model identifies and explains the factors. The study finds that there are 11 most influential common features in China and 9 in the United States. The two countries have 5 common features, the meta-cognition assess credibility, summarizing text ability, PISA test difficulty perception, science learning time, and school lessons numbers per week. Family economic status also impacts personal ability. Regarding subject characteristics, attitude towards failure is the determinant of reading and mathematics. Cooperation and competition among students help to improve mathematics and science. Furthermore, the comparison between the two countries concludes that self-awareness, family economic status, and school learning environment are critical to personal ability. The study concludes that it is necessary to foster a sense of healthy competition among students at the school level and provide more attention to students with low family socioeconomic status to improve their abilities. Keywords: machine learning approach; non-cognitive factors; PISA 2018; personal ability

Simple SummaryThe objective response rate of lenvatinib combined with transarterial chemoembolization for unresectable hepatocellular carcinoma is unsatisfactory. We aimed to develop predictive models using demographic characteristics, pre-treatment serum biomarkers and tumor characteristics of unresectable hepatocellular carcinoma patients by five machine learning algorithms to predict the response under combined treatments. We identified the 10 most important predictors, including K, low-density lipoprotein, D-dimer, red blood cell, alanine aminotransferase, albumin, monocyte, tumor size, triglyceride, and age. In addition, we applied the Shapley Additive exPlanation to explain the best-performing random forest predictive model to provide a reasonable explanation of the efficacy prediction at an individualized level. The combination of machine learning and Shapley Additive exPlanation can provide valuable suggestions for clinical decision making.Background: Lenvatinib and transarterial chemoembolization (TACE) are first-line treatments for unresectable hepatocellular carcinoma (HCC), but the objective response rate (ORR) is not satisfactory. We aimed to predict the response to lenvatinib combined with TACE before treatment for unresectable HCC using machine learning (ML) algorithms based on clinical data. Methods: Patients with unresectable HCC receiving the combination therapy of lenvatinib combined with TACE from two medical centers were retrospectively collected from January 2020 to December 2021. The response to the combination therapy was evaluated over the following 4–12 weeks. Five types of ML algorithms were applied to develop the predictive models, including classification and regression tree (CART), adaptive boosting (AdaBoost), extreme gradient boosting (XGBoost), random forest (RF), and support vector machine (SVM). The performance of the models was assessed by the receiver operating characteristic (ROC) curve and area under the receiver operating characteristic curve (AUC). The Shapley Additive exPlanation (SHAP) method was applied to explain the model. Results: A total of 125 unresectable HCC patients were included in the analysis after the inclusion and exclusion criteria, among which 42 (33.6%) patients showed progression disease (PD), 49 (39.2%) showed stable disease (SD), and 34 (27.2%) achieved partial response (PR). The nonresponse group (PD + SD) included 91 patients, while the response group (PR) included 34 patients. The top 40 most important features from all 64 clinical features were selected using the recursive feature elimination (RFE) algorithm to develop the predictive models. The predictive power was satisfactory, with AUCs of 0.74 to 0.91. The SVM model and RF model showed the highest accuracy (86.5%), and the RF model showed the largest AUC (0.91, 95% confidence interval (CI): 0.61–0.95). The SHAP summary plot and decision plot illustrated the impact of the top 40 features on the efficacy of the combination therapy, and the SHAP force plot successfully predicted the efficacy at the individualized level. Conclusions: A new predictive model based on clinical data was developed using ML algorithms, which showed favorable performance in predicting the response to lenvatinib combined with TACE for unresectable HCC. Combining ML with SHAP could provide an explicit explanation of the efficacy prediction.