Cloud-based machine learning for scalable classification of software requirements: Insights from the PROMISE dataset

Fall prevention has always been a crucial topic for injury prevention. Research shows that real-time posture monitoring and subsequent fall prevention are important for the prevention of fall-related injuries. In this research, we determine a real-time posture classifier by comparing classical and deep machine learning classifiers in terms of their accuracy and robustness for posture classification. For this, multiple classical classifiers, including classical machine learning, support vector machine, random forest, neural network, and Adaboost methods, were used. Deep learning methods, including LSTM and transformer, were used for posture classification. In the experiment, joint data were obtained using an RGBD camera. The results show that classical machine learning posture classifier accuracy was between 75% and 99%, demonstrating that the use of classical machine learning classification alone is sufficient for real-time posture classification even with missing joints or added noise. The deep learning method LSTM was also effective in classifying the postures with high accuracy, despite incurring a significant computational overhead cost, thus compromising the real-time posture classification performance. The research thus shows that classical machine learning methods are worthy of our attention, at least, to consider for reuse or reinvention, especially for real-time posture classification tasks. The insight of using a classical posture classifier for large-scale human posture classification is also given through this research.

Machine learning has achieved remarkable success across diverse domains. Nevertheless, concerns about interpretability in black-box models, especially within Deep Neural Networks (DNNs), have become pronounced in safety-critical fields like healthcare and finance. Classical machine learning (ML) classifiers, known for their higher interpretability, are preferred in these domains. Similar to DNNs, classical ML classifiers can exhibit bugs that could lead to severe consequences in practice. Test input prioritization has emerged as a promising approach to ensure the quality of an ML system, which prioritizes potentially misclassified tests so that such tests can be identified earlier with limited manual labeling costs. However, when applying to classical ML classifiers, existing DNN test prioritization methods are constrained from three perspectives: 1) Coverage-based methods are inefficient and time-consuming; 2) Mutation-based methods cannot be adapted to classical ML models due to mismatched model mutation rules; 3) Confidence-based methods are restricted to a single dimension when applying to binary ML classifiers, solely depending on the model’s prediction probability for one class. To overcome the challenges, we propose MLPrior, a test prioritization approach specifically tailored for classical ML models. MLPrior leverages the characteristics of classical ML classifiers (i.e., interpretable models and carefully engineered attribute features) to prioritize test inputs. The foundational principles are: 1) tests more sensitive to mutations are more likely to be misclassified, and 2) tests closer to the model’s decision boundary are more likely to be misclassified. Building on the first concept, we design mutation rules to generate two types of mutation features (i.e., <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">model mutation features</b> and <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">input mutation features</b> ) for each test. Drawing from the second notion, MLPrior generates <bold xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">attribute features</b> of each test based on its attribute values, which can indirectly reveal the proximity between the test and the decision boundary. For each test, MLPrior combines all three types of features of it into a final vector. Subsequently, MLPrior employs a pre-trained ranking model to predict the misclassification probability of each test based on its final vector and ranks tests accordingly. We conducted an extensive study to evaluate MLPrior based on 185 subjects, encompassing natural datasets, mixed noisy datasets, and fairness datasets. The results demonstrate that MLPrior outperforms all the compared test prioritization approaches, with an average improvement of 14.74%∼66.93% on natural datasets, 18.55%∼67.73% on mixed noisy datasets, and 15.34%∼62.72% on fairness datasets.

The detection accuracy and model building time of machine learning (ML) classifiers are vital aspects for an intrusion detection system (IDS) to predict attacks in real life. Recently, researchers have introduced feature selection methods to increase the detection accuracy and minimize the model building time of a limited number of ML classifiers. Therefore, identifying more ML classifiers with very high detection accuracy and the lowest possible model building time is necessary. In this study, the authors tested six supervised classifiers on a full NSL-KDD training dataset (a benchmark record for Internet traffic) using 10-fold cross-validation in the Weka tool with and without feature selection/reduction methods. The authors aimed to identify more options to outperform and secure classifiers with the highest detection accuracy and lowest model building time. The results show that the feature selection/reduction methods, including the wrapper method in combination with the discretize filter, the filter method in combination with the discretize filter, and the discretize filter, can significantly decrease model building time without compromising detection accuracy. The suggested ML algorithms and feature selection/reduction methods are automated pattern recognition approaches to detect network attacks, which are within the scope of the Symmetry journal.

Malware detection at the hardware level has emerged recently as a promising solution to improve the security of computing systems. Hardware-based malware detectors take advantage of Machine Learning (ML) classifiers to detect pattern of malicious applications at run-time. These ML classifiers are trained using low-level features such as processor Hardware Performance Counters (HPCs) data which are captured at run-time to appropriately represent the application behaviour. Recent studies show the potential of standard ML-based classifiers for detecting malware using analysis of large number of microarchitectural events, more than the very limited number of HPC registers available in today’s microprocessors which varies from 2 to 8. This results in executing the application more than once to collect the required data, which in turn makes the solution less practical for effective run-time malware detection. Our results show a clear trade-off between the performance of standard ML classifiers and the number and diversity of HPCs available in modern microprocessors. This paper proposes a machine learning-based solution to break this trade-off to realize effective run-time detection of malware. We propose ensemble learning techniques to improve the performance of the hardware-based malware detectors despite using a very small number of microarchitectural events that are captured at run-time by existing HPCs, eliminating the need to run an application several times. For this purpose, eight robust machine learning models and two well-known ensemble learning classifiers applied on all studied ML models (sixteen in total) are implemented for malware detection and precisely compared and characterized in terms of detection accuracy, robustness, performance (accuracy × robustness), and hardware overheads. The experimental results show that the proposed ensemble learning-based malware detection with just 2 HPCs using ensemble technique outperforms standard classifiers with 8 HPCs by up to 17%. In addition, it can match the robustness and performance of standard ML-based detectors with 16 HPCs while using only 4 HPCs allowing effective run-time detection of malware.

Quantitative EEG features and machine learning classifiers for eye-blink artifact detection: A comparative study

This research aims to identify the best machine learning (ML) classification techniques for classifying the flow regimes in vertical gas-liquid two-phase flow. Two-phase flow regime identification is crucial for many operations in the oil and gas industry. Processes such as flow assurance, well control, and production rely heavily on accurate identification of flow regimes for their respective systems' smooth functioning. The primary motivation for the proposed ML classification algorithm selection processes was drilling and well control applications in Deepwater wells. The process started with vertical two-phase flow data collection from literature and two different flow loops. One, a 140 ft. tall vertical flow loop with a centralized inner metal pipe and a larger outer acrylic pipe. Second, an 18-ft long flow loop, also with a centralized, inner metal drill pipe. After extensive experimental and historical data collection, supervised and unsupervised ML classification models such as Multi-class Support vector machine (MCSVM), K-Nearest Neighbor Classifier (KNN), K-means clustering, and hierarchical clustering were fit on the datasets to separate the different flow regions. The next step was fine-tuning the models' parameters and kernels. The last step was to compare the different combinations of models and refining techniques for the best prediction accuracy and the least variance. Among the different models and combinations with refining techniques, the 5- fold cross-validated KNN algorithm, with 37 neighbors, gave the optimal solution with a 98% classification accuracy on the test data. The KNN model distinguished five major, distinct flow regions for the dataset and a few minor regions. These five regions were bubbly flow, slug flow, churn flow, annular flow, and intermittent flow. The KNN-generated flow regime maps matched well with those presented by Hasan and Kabir (2018). The MCSVM model produced visually similar flow maps to KNN but significantly underperformed them in prediction accuracy. The MCSVM training errors ranged between 50% - 60% at normal parameter values and costs but went up to 99% at abnormally high values. However, their prediction accuracy was below 50% even at these highly overfitted conditions. In unsupervised models, both clustering techniques pointed to an optimal cluster number between 10 and 15, consistent with the 14 we have in the dataset. Within the context of gas kicks and well control, a well-trained, reliable two-phase flow region classification algorithm offers many advantages. When trained with well-specific data, it can act as a black box for flow regime identification and subsequent well-control measure decisions for the well. Further advancements with more robust statistical training techniques can render these algorithms as a basis for well-control measures in drilling automation software. On a broader scale, these classification techniques have many applications in flow assurance, production, and any other area with gas-liquid two-phase flow.

To determine whether topographical measurements of the parapapillary region analyzed by machine learning classifiers can detect early to moderate glaucoma better than similarly processed measurements obtained within the disc margin and to improve methods for optimization of machine learning classifier feature selection. One eye of each of 95 patients with early to moderate glaucomatous visual field damage and of each of 135 normal subjects older than 40 years participating in the longitudinal Diagnostic Innovations in Glaucoma Study (DIGS) were included. Heidelberg Retina Tomograph (HRT; Heidelberg Engineering, Dossenheim, Germany) mean height contour was measured in 36 equal sectors, both along the disc margin and in the parapapillary region (at a mean contour line radius of 1.7 mm). Each sector was evaluated individually and in combination with other sectors. Gaussian support vector machine (SVM) learning classifiers were used to interpret HRT sector measurements along the disc margin and in the parapapillary region, to differentiate between eyes with normal and glaucomatous visual fields and to compare the results with global and regional HRT parameter measurements. The area under the receiver operating characteristic (ROC) curve was used to measure diagnostic performance of the HRT parameters and to evaluate the cross-validation strategies and forward selection and backward elimination optimization techniques that were used to generate the reduced feature sets. The area under the ROC curve for mean height contour of the 36 sectors along the disc margin was larger than that for the mean height contour in the parapapillary region (0.97 and 0.85, respectively). Of the 36 individual sectors along the disc margin, those in the inferior region between 240 degrees and 300 degrees, had the largest area under the ROC curve (0.85-0.91). With SVM Gaussian techniques, the regional parameters showed the best ability to discriminate between normal eyes and eyes with glaucomatous visual field damage, followed by the global parameters, mean height contour measures along the disc margin, and mean height contour measures in the parapapillary region. The area under the ROC curve was 0.98, 0.94, 0.93, and 0.85, respectively. Cross-validation and optimization techniques demonstrated that good discrimination (99% of peak area under the ROC curve) can be obtained with a reduced number of HRT parameters. Mean height contour measurements along the disc margin discriminated between normal and glaucomatous eyes better than measurements obtained in the parapapillary region.

Background: Early identification of probable post-traumatic stress disorder (PTSD) can lead to early intervention and treatment.Aims: This study aimed to evaluate supervised machine learning (ML) classifiers for the identification of probable PTSD in those who are serving, or have recently served in the United Kingdom (UK) Armed Forces.Methods: Supervised ML classification techniques were applied to a military cohort of 13,690 serving and ex-serving UK Armed Forces personnel to identify probable PTSD based on self-reported service exposures and a range of validated self-report measures. Data were collected between 2004 and 2009.Results: The predictive performance of supervised ML classifiers to detect cases of probable PTSD were encouraging when compared to a validated measure, demonstrating a capability of supervised ML to detect the cases of probable PTSD. It was possible to identify which variables contributed to the performance, including alcohol misuse, gender and deployment status. A satisfactory sensitivity was obtained across a range of supervised ML classifiers, but sensitivity was low, indicating a potential for false negative diagnoses.Conclusions: Detection of probable PTSD based on self-reported measurement data is feasible, may greatly reduce the burden on public health and improve operational efficiencies by enabling early intervention, before manifestation of symptoms.

Magnetic resonance imaging (MRI) is playing an important role in the classification of breast tumors. MRI can be used to obtain multiparametric (mp) information, such as structural, hemodynamic, and physiological information. Quantitative analysis of mp-MRI data has shown potential in improving the accuracy of breast tumor classification. In general, a large set of quantitative and texture features can be generated depending upon the type of methodology used. A suitable combination of selected quantitative and texture features can further improve the accuracy of tumor classification. Machine learning (ML) classifiers based upon features derived from MRI data have shown potential in tumor classification. There is a need for further research studies on selecting an appropriate combination of features and evaluating the performance of different ML classifiers for accurate classification of breast tumors. The objective of the current study was to develop and optimize an ML framework based upon mp-MRI features for the characterization of breast tumors (malignant vs. benign and low- vs. high-grade). This study included the breast mp-MRI data of 60 female patients with histopathology results. A total of 128 features were extracted from the mp-MRI tumor data followed by features selection. Five ML classifiers were evaluated for tumor classification using 10-fold crossvalidation with 10 repetitions. The support vector machine (SVM) classifier based on optimum features selected using a wrapper method with an adaptive boosting (AdaBoost) technique provided the highest sensitivity (0.96 ± 0.03), specificity (0.92 ± 0.09), and accuracy (94% ± 2.91%) in the classification of malignant versus benign tumors. This method also provided the highest sensitivity (0.94 ± 0.07), specificity (0.80 ± 0.05), and accuracy (90% ± 5.48%) in the classification of low- versus high-grade tumors. These findings suggest that the SVM classifier outperformed other ML methods in the binary classification of breast tumors.

Researchers have extensively employed machine learning (ML) approaches to establish forecasting systems in numerous domains like software faults, spam identification, disease foresting, and fraud recognition. The detection of individuals susceptible to heart disease (HD) could assist medical practitioners in their verdict concerning treatments and management. This study, therefore, is projected to examine the discriminative power of numerous prognosticators in the research to intensify the efficiency of HD discovery through their warning signs. A dimensionality reduction method called principal component analysis (PCA) and three machine learning (ML) classifiers which are Naïve Bayes (NB), random forest (RF), and support vector machine (SVM) are employed in the study. The three ML classifiers were implemented with PCA DR. The techniques’ performance was evaluated on a dataset attained from National Health Service (NHS) database. The system was evaluated using confusion matrix measures for instance, accuracy, precision, specificity, f1-score, detection rate, and false-positive rate (FPR). A comparative analysis was conducted between the three ML classifiers with PCA DR. It was concluded that the classifiers.KeywordsMachine learningPCASupport vector machineRandom forestNaïve Bayes

Food quality analysis can be carried out by spectral data acquired from spectrometers with its advantage of non-destructive way of testing. Portable and miniature spectroscopy can be a suitable solution when it meets the specifications such as portability, cost, and short processing time requirements, to enable ordinary citizens to use such a device in the fight against food fraud. Compared to more expensive, bulky, and non-portable devices, the data collected using miniature and portable spectrometers is of a lower quality and thus adversely affect the quality of the analysis. Research have been carried out to use machine learning (ML) classifiers on spectral data analysis for food quality assessment. The present work focuses on two aspects: firstly, preliminary exploratory statistical analysis is conducted on the real spectral data on different food products including oils, fruits and spices acquired from such miniature devices, which aims to evaluate and illustrate the distinctive characteristics of such spectral data, data distribution and difference in the spectra across multiple data acquisitions etc. along with a summary of the key challenges to face and explore. Secondly, a case study for the differentiation of extra virgin olive from adulterated with vegetable oil is provided to analyze and evaluate how some commonly used ML classifiers can be used for classification, while the impact of different preprocessing methods to improve the accuracy and efficiency is also provided. The case study demonstrates the good potential of using data analytics for spectral data from miniature device, although the overall performance of those ML classifiers is not exceptional (the classification rates of up to 83.32%) which is partially due to the quality of data, and partially due to limiting to only some classifiers. More elaborate data pre-processing and cleaning methods can be used to address the key challenges of the spectral data from miniature device, and other types of classifiers can be also explored further in future work.

Diabetic Retinopathy (DR) is a highly threatening microvascular complication of diabetes mellitus. Diabetic patients must be screened annually for DR; however, it is practically not viable due to the high volume of patients, lack of resources, economic burden, and cost of the screening procedure. The use of machine learning (ML) classifiers in medical science is an emerging frontier and can help in assisted diagnosis. The few available proposed models perform best when used in similar population cohorts and their external validation has been questioned. Therefore, the purpose of our research is to classify the DR using different ML methods on Saudi diabetic data, propose the best method based on accuracy and identify the most discriminative interpretable features using the socio-demographic and clinical information. This cross-sectional study was conducted among 327 diabetic patients in Almajmaah, Saudi Arabia. Socio-demographic and clinical data were collected using a systematic random sampling technique. For DR classification, ML algorithm including, linear discriminant analysis, support vector machine, K nearest neighbor, random forest and its variate ranger random forest classifiers were used through cross-validation resampling procedure. In classifying DR, ranger random forest outperforms the other methods by accurately classifying 86% of the DR patients on the test data. HbA1c (p<0.001) and duration of diabetes (p<0.001) were the most influential risk factor that best discriminated the DR patients. Other influential risk factors were the body mass index (p<0.001), age-onset (p<0.001), age (p<0.001), systolic blood pressure (p<0.05), and the use of medication (p<0.05) that significantly discriminated the DR patients. Based on the present study findings, integrating ophthalmology and ML can transform diagnosing the disease pattern that can help generate a compelling clinical effect. ML can be used as an added tool for clinical decision-making and must not be the sole substitute for a clinician. We will work to examine the classification performance of multi-class data using more sophisticated ML methods.

&lt;p&gt;In March of 2020, the World Health Organization identified COVID-19 as a new pandemic and issued a statement to that effect. This fatal virus was able to disperse and propagate throughout several countries all over the world. During the progression of the pandemic, social networking sites like Twitter generated significant and substantial volumes of data that helped improve the quality of decisions pertaining to health care applications. In this paper, we proposed a sentiment classification using various feature extraction and machine leavening techniques for social media dataset. The system has divided into four phase data collection, preprocessing and normalization, feature extraction and feature selection and finally classification. In first phase we collect data from social media sources such as twitter using Twitter API. In second phase the tweets, data was ready for preprocessing and it was sorted into three categories: positive, neutral, and negative. During the third phase, various features were extracted from the tweets by employing a number of widely utilized approaches, including as bag of words (BoW), Term Frequency-Inverse Document Frequency (TF-IDF), Word2Vec, and FastText, to gather feature datasets. These methods were employed to extract distinct datasets for the features. The final phase different machine learning classification algorithms are applied for detection of sentiment using machine learning. In the extensive experimental analysis, the BoW performed better results with modified support vector machine (mSVM) than existing machine learning algorithms. The proposed mSVM performed superiorly to the other classifiers by 98.15% accuracy rate. Once the tweets are correctly classified as COVID-19 tweets, it is further categorized into three sentiments that is positive, negative and neural. Proposed mSVM achieves 93% of accuracy rate for positive sentiment which better as compared to other Machine Learning (ML) classifiers.&lt;/p&gt;

Gesture recognition is a topic in computer science and language technology that aims to interpret human gestures with computer programs and many different algorithms. It can be seen as the way computers can understand human body language. Today, the main interaction tools between computers and humans are still the keyboard and mouse. Gesture recognition can be used as a tool for communication with the machine and interaction without any mechanical device such as a keyboard or mouse. In this paper, we present the results of a comparison of eight different machine learning (ML) classifiers in the task of human hand gesture recognition and classification to explore how to efficiently implement one or more tested ML algorithms on an 8-bit AVR microcontroller for on-line human gesture recognition with the intention to gesturally control the mobile robot. The 8-bit AVR microcontrollers are still widely used in the industry, but due to their lack of computational power and limited memory, it is a challenging task to efficiently implement ML algorithms on them for on-line classification. Gestures were recorded by using inertial sensors, gyroscopes, and accelerometers placed at the wrist and index finger. One thousand and eight hundred (1800) hand gestures were recorded and labelled. Six important features were defined for the identification of nine different hand gestures using eight different machine learning classifiers: Decision Tree (DT), Random Forests (RF), Logistic Regression (LR), Linear Discriminant Analysis (LDA), Support Vector Machine (SVM) with linear kernel, Naïve Bayes classifier (NB), K-Nearest Neighbours (KNN), and Stochastic Gradient Descent (SGD). All tested algorithms were ranged according to Precision, Recall, and F1-score (abb.: P-R-F1). The best algorithms were SVM (P-R-F1: 0.9865, 0.9861, and 0.0863), and RF (P-R-F1: 0.9863, 0.9861, and 0.0862), but their main disadvantage is their unusability for on-line implementations in 8-bit AVR microcontrollers, as proven in the paper. The next best algorithms have had only slightly poorer performance than SVM and RF: KNN (P-R-F1: 0.9835, 0.9833, and 0.9834) and LR (P-R-F1: 0.9810, 0.9810, and 0.9810). Regarding the implementation on 8-bit microcontrollers, KNN has proven to be inadequate, like SVM and RF. However, the analysis for LR has proved that this classifier could be efficiently implemented on targeted microcontrollers. Having in mind its high F1-score (comparable to SVM, RF, and KNN), this leads to the conclusion that the LR is the most suitable classifier among tested for on-line applications in resource-constrained environments, such as embedded devices based on 8-bit AVR microcontrollers, due to its lower computational complexity in comparison with other tested algorithms.

Cumulative exposure to head impacts during contact sports can elicit potentially deleterious brain white matter alterations in young athletes. Head impact exposure is commonly quantified using wearable sensors; however, these sensors tend to overestimate the number of true head impacts that occur and may obfuscate potential relationships with longitudinal brain changes. The purpose of this study was to examine whether data-driven filtering of head impact exposure using machine learning classification could produce more accurate quantification of exposure and whether this would reveal more pronounced relationships with longitudinal brain changes. Season-long head impact exposure was recorded for 22 female high school soccer athletes and filtered using three methods-threshold-based, heuristic filtering, and machine learning (ML) classification. The accuracy of each method was determined using simultaneous video recording of a subset of the sensor-recorded impacts, which was used to confirm which sensor-recorded impacts corresponded with true head impacts and the ability of each method to detect the true impacts. Each filtered dataset was then associated with the athletes' pre- and post-season MRI brain scans to reveal longitudinal white matter changes. The threshold-based, heuristic, and ML approaches achieved 22.0% accuracy, 44.6%, and 83.5% accuracy, respectively. ML classification also revealed significant longitudinal brain white matter changes, with negative relationships observed between head impact exposure and reductions in mean and axial diffusivity and a positive relationship observed between exposure and fractional anisotropy (all p < 0.05).