A systematic literature review of machine learning methods applied to predictive maintenance

PurposeInjuries are common in sports and can have significant physical, psychological and financial consequences. Machine learning (ML) methods could be used to improve injury prediction and allow proper approaches to injury prevention. The aim of our study was therefore to perform a systematic review of ML methods in sport injury prediction and prevention.MethodsA search of the PubMed database was performed on March 24th 2020. Eligible articles included original studies investigating the role of ML for sport injury prediction and prevention. Two independent reviewers screened articles, assessed eligibility, risk of bias and extracted data. Methodological quality and risk of bias were determined by the Newcastle–Ottawa Scale. Study quality was evaluated using the GRADE working group methodology.ResultsEleven out of 249 studies met inclusion/exclusion criteria. Different ML methods were used (tree-based ensemble methods (n = 9), Support Vector Machines (n = 4), Artificial Neural Networks (n = 2)). The classification methods were facilitated by preprocessing steps (n = 5) and optimized using over- and undersampling methods (n = 6), hyperparameter tuning (n = 4), feature selection (n = 3) and dimensionality reduction (n = 1). Injury predictive performance ranged from poor (Accuracy = 52%, AUC = 0.52) to strong (AUC = 0.87, f1-score = 85%). ConclusionsCurrent ML methods can be used to identify athletes at high injury risk and be helpful to detect the most important injury risk factors. Methodological quality of the analyses was sufficient in general, but could be further improved. More effort should be put in the interpretation of the ML models.

Parameter importance assessment improves efficacy of machine learning methods for predicting snow avalanche sites in Leh-Manali Highway, India

Machine learning (ML) methods are attracting considerable attention among academics in the field of finance. However, it is commonly believed that ML has not transformed the asset management industry to the same extent as other sectors. This survey focuses on the ML methods and empirical results available in the literature that matter most for active portfolio management. ML has asset management applications for signal generation, portfolio construction, and trade execution, and promising findings have been reported. Reinforcement learning (RL), in particular, is expected to play a more significant role in the industry. Nevertheless, the performance of a sample of active exchange-traded funds (ETF) that use ML in their investments tends to be mixed. Overall, ML techniques show great promise for active portfolio management, but investors should be cautioned against their main potential pitfalls. 
\n
\n

Artificial intelligence has been applied in wildfire science and management since the 1990s, with early applications including neural networks and expert systems. Since then, the field has rapidly progressed congruently with the wide adoption of machine learning (ML) methods in the environmental sciences. Here, we present a scoping review of ML applications in wildfire science and management. Our overall objective is to improve awareness of ML methods among wildfire researchers and managers, as well as illustrate the diverse and challenging range of problems in wildfire science available to ML data scientists. To that end, we first present an overview of popular ML approaches used in wildfire science to date and then review the use of ML in wildfire science as broadly categorized into six problem domains, including (i) fuels characterization, fire detection, and mapping; (ii) fire weather and climate change; (iii) fire occurrence, susceptibility, and risk; (iv) fire behavior prediction; (v) fire effects; and (vi) fire management. Furthermore, we discuss the advantages and limitations of various ML approaches relating to data size, computational requirements, generalizability, and interpretability, as well as identify opportunities for future advances in the science and management of wildfires within a data science context. In total, to the end of 2019, we identified 300 relevant publications in which the most frequently used ML methods across problem domains included random forests, MaxEnt, artificial neural networks, decision trees, support vector machines, and genetic algorithms. As such, there exists opportunities to apply more current ML methods — including deep learning and agent-based learning — in the wildfire sciences, especially in instances involving very large multivariate datasets. We must recognize, however, that despite the ability of ML models to learn on their own, expertise in wildfire science is necessary to ensure realistic modelling of fire processes across multiple scales, while the complexity of some ML methods such as deep learning requires a dedicated and sophisticated knowledge of their application. Finally, we stress that the wildfire research and management communities play an active role in providing relevant, high-quality, and freely available wildfire data for use by practitioners of ML methods.

A dose deposition matrix (DDM) prediction method using several voxel features and a machine learning (ML) approach is proposed for plan optimization in radiation therapy. Head and lung cases with the inhomogeneous medium are used as training and testing data. The prediction model is a cascade forward backprop neural network where the input is the features of the voxel, including 1) voxel to body surface distance along the beamlet axis, 2) voxel to beamlet axis distance, 3) voxel density, 4) heterogeneity corrected voxel to body surface distance, 5) heterogeneity corrected voxel to beamlet axis, and (6) the dose of voxel obtained from the pencil beam (PB) algorithm. The output is the predicted voxel dose corresponding to a beamlet. The predicted DDM was used for plan optimization (ML method) and compared with the dose of MC-based plan optimization (MC method) and the dose of pencil beam-based plan optimization (PB method). The mean absolute error (MAE) value was calculated for full volume relative to the dose of the MC method to evaluate the overall dose performance of the final plan. For patient with head tumor, the ML method achieves MAE value 0.49 × 10-4 and PB has MAE 1.86 × 10-4. For patient with lung tumor, the ML method has MAE 1.42 × 10-4 and PB has MAE 3.72 × 10-4. The maximum percentage difference in PTV dose coverage (D98) between ML and MC methods is no more than 1.2% for patient with head tumor, while the difference is larger than 10% using the PB method. For patient with lung tumor, the maximum percentage difference in PTV dose coverage (D98) between ML and MC methods is no more than 2.1%, while the difference is larger than 16% using the PB method. In this work, a reliable DDM prediction method is established for plan optimization by applying several voxel features and the ML approach. The results show that the ML method based on voxel features can obtain plans comparable to the MC method and is better than the PB method in achieving accurate dose to the patient, which is helpful for rapid plan optimization and accurate dose calculation. Establishment of a new machine learning method based on the relationship between the voxel and beamlet features for dose deposition matrix prediction in radiation therapy.

Efficient seismic fragility analysis method utilizing ground motion clustering and probabilistic machine learning

Longitudinal data, while often limited, contain valuable insights into features impacting clinical outcomes. To predict the progression of chronic kidney disease (CKD) in patients with metabolic syndrome, particularly those transitioning from stage 3a to 3b, where data are scarce, utilizing feature ensemble techniques can be advantageous. It can effectively identify crucial risk factors, influencing CKD progression, thereby enhancing model performance. Machine learning (ML) methods have gained popularity due to their ability to perform feature selection and handle complex feature interactions more effectively than traditional approaches. However, different ML methods yield varying feature importance information. This study proposes a multiphase hybrid risk factor evaluation scheme to consider the diverse feature information generated by ML methods. The scheme incorporates variable ensemble rules (VERs) to combine feature importance information, thereby aiding in the identification of important features influencing CKD progression and supporting clinical decision making. In the proposed scheme, we employ six ML models-Lasso, RF, MARS, LightGBM, XGBoost, and CatBoost-each renowned for its distinct feature selection mechanisms and widespread usage in clinical studies. By implementing our proposed scheme, thirteen features affecting CKD progression are identified, and a promising AUC score of 0.883 can be achieved when constructing a model with them.

Developing Theory Using Machine Learning Methods

How Magic a Bullet Is Machine Learning for Credit Analysis? An Exploration with FinTech Lending Data

Large and complex data sets are increasingly available for research in critical care. To analyze these data, researchers use techniques commonly referred to as statistical learning or machine learning (ML). The latter is known for large successes in the field of diagnostics, for example, by identification of radiological anomalies. In other research areas, such as clustering and prediction studies, there is more discussion regarding the benefit and efficiency of ML techniques compared with statistical learning. In this viewpoint, we aim to explain commonly used statistical learning and ML techniques and provide guidance for responsible use in the case of clustering and prediction questions in critical care. Clustering studies have been increasingly popular in critical care research, aiming to inform how patients can be characterized, classified, or treated differently. An important challenge for clustering studies is to ensure and assess generalizability. This limits the application of findings in these studies toward individual patients. In the case of predictive questions, there is much discussion as to what algorithm should be used to most accurately predict outcome. Aspects that determine usefulness of ML, compared with statistical techniques, include the volume of the data, the dimensionality of the preferred model, and the extent of missing data. There are areas in which modern ML methods may be preferred. However, efforts should be made to implement statistical frameworks (e.g., for dealing with missing data or measurement error, both omnipresent in clinical data) in ML methods. To conclude, there are important opportunities but also pitfalls to consider when performing clustering or predictive studies with ML techniques. We advocate careful valuation of new data-driven findings. More interaction is needed between the engineer mindset of experts in ML methods, the insight in bias of epidemiologists, and the probabilistic thinking of statisticians to extract as much information and knowledge from data as possible, while avoiding harm.

Machine learning guided design of functional materials with targeted properties

This paper presents an evaluation of the accuracy of machine learning (ML) techniques in forecasting the realized volatility of West Texas Intermediate (WTI) crude oil prices. We compare several ML algorithms, including regularization, regression trees, random forests, and neural networks, to several heterogeneous autoregressive (HAR) models. The results show that the ML and regularization methods are efficient, even when there are only three predictors: daily, weekly, and monthly realized volatility (RV) lags. In addition, when the ML and regularization methods are applied, the results become more pronounced over longer forecasting horizons, as well as for weekly and monthly horizons. These ML methods are effective in approximating long‐term realized volatility. Furthermore, we found that additional explanatory variables for real‐time currency exchange contain valuable information to forecast the RV of crude oil prices.

Cardiovascular diseases (CVDs) remain a leading cause of global mortality, underscoring the urgent need for early and accurate diagnosis. Electrocardiograms (ECGs) are a widely used, noninvasive tool for detecting cardiac abnormalities, but manual interpretation can be time- consuming and prone to error. This study explores advanced machine learning (ML) and deep learning (DL) methods to improve the detection of CVDs from ECG images, leveraging their ability to analyze complex patterns with high precision. Models such as Convolutional Neural Networks (CNNs), Vision Transformers (ViTs), and ensemble frameworks are utilized, alongside traditional ML models like XGBoost, CatBoost, and LightGBM. The performance of these models is evaluated based on precision, recall, F1-score, and accuracy. Results show that DL models, particularly an ensemble of CNN and ViT, achieve superior accuracy , outperforming standalone ML methods. Furthermore, an ensemble of XGBoost, CatBoost, and LightGBM achieves competitive results, while Optuna-tuned XGBoost further enhances ML performance. The findings highlight the potential of combining ML and DL techniques for robust and reliable CVD detection in ECG images. This research demonstrates the promise of AI-driven solutions in advancing medical diagnostics and supports the integration of automated systems for early detection of cardiovascular diseases.

The latest technological advancements in the development and production of sensors have led to their increased usage in marine science, thus expanding data volume and rates within the field. The extensive data collection efforts to monitor and maintain the health of marine environments supports the efforts in data driven learning, which can help policy makers in making effective decisions. Machine learning techniques show a lot of promise for improving the quality and scope of marine research by detecting implicit patterns and hidden trends, especially in big datasets that are difficult to analyze with traditional methods. Machine learning is extensively used on marine science data collected in various regions, but it has not been applied in a significant way to data generated in the Gulf of Mexico (GOM). Machine learning methods using ocean science data are showing encouraging results and thus are drawing interest from data science researchers and marine scientists to further the research. The purpose of this paper is to review the existing approaches in studying GOM data, the state of the art in machine learning techniques as applied to the GOM, and propose solutions to GOM data problems. We review several issues faced by marine environments in GOM in addition to climate change and its effects. We also present machine learning techniques and methods used elsewhere to address similar problems and propose applications to problems in the GOM. We find that Harmful Algal Blooms (HABs), hypoxia, and sea-level rises have not received as much attention as other climate change problems and within the machine learning literature, the impacts on estuaries and coastal systems, as well as oyster mortality (also major problems for the GOM) have been understudied – we identify those as important areas for improvement. We anticipate this manuscript will act as a baseline for data science researchers and marine scientists to solve problems in the GOM collaboratively and/or independently.

P125. Development of a novel ensemble machine learning algorithm for prediction of complications and readmission after anterior cervical spinal fusion