Machine Learning Classifiers Based on HoG Features Extracted from Locomotive Neutral Section Images

Although the consortium blockchains commonly adopt consensus algorithms with Byzantine fault tolerance (such as practical Byzantine fault tolerance (PBFT)), its consensus efficiency will be degraded by the existence of malicious nodes or behaviors. However, the existing researches mainly focus on the detection of malicious behaviors for public blockchains, but are rare about consortium blockchains. In this paper, an anomaly detection model based on machine learning (ML) classification algorithm is proposed for consortium blockchains that adopt PBFT. Besides, a two-stage process is proposed to reduce the resource consumption for anomaly detection. The data needed for proposed model only has two dimensions and is convenient to obtain. The results of experiment show that ML is very effective in anomaly detection for consortium blockchains. Specifically, the algorithms with the highest accuracy are convolutional neural networks (CNN), k-nearest neighbor (KNN) and support vector machines (SVM) in turn. However, KNN and SVM are more suitable because resource consumption of both algorithms are one third of CNN, and the accuracy rates are above 0.9 which is 0.9% lower than CNN.

Image classification is critical in computer vision, with numerous applications ranging from e-commerce to medical imaging. This study provides a comprehensive evaluation of traditional machine learning algorithms for image classification, implementing and analysing novel fault tolerance mechanisms amongst these algorithms. The authors compared the performance of K-Nearest Neighbors (KNN), Decision Trees, Random Forest, and XGBoost on both Fashion MNIST and CIFAR-10 datasets. The comparison was extended to include Support Vector Machine (SVM), Logistic Regression, and Naive Bayes classifiers in order to expand the evaluation of these models on the indicated datasets. Key findings demonstrated the superiority of ensemble methods, particularly XGBoost, which achieved 89.31% of accuracy on Fashion MNIST and 54.93% on CIFAR-10, consistently outperforming other models across various configurations. Random Forest exhibited robust performance as the secondbest model, reaching 87.42% and 51.64% of accuracy on the respective datasets. The significant performance gap between datasets demonstrated the challenges that traditional machine learning models face with complex image data. Implementing the fault tolerance framework in this study has also shown a remarkable effectiveness, achieved a 94.6% recovery rate while maintaining model accuracy within 0.1% of standard implementations. This was achieved with minimal computational overhead (2.3% of training time and 1.8% of memory usage), making it highly practical for production deployments. The system significantly reduced operational failures, decreasing crashes from 5.2 to 0.3 per day and increasing average uptime from 4.3 to 12.0 hours. The study also reveals important insights regarding model scalability and resource requirements, with memory usage varying significantly across models (325MB to 8,923MB). These findings provide valuable guidance for practitioners in selecting and implementing machine learning models for image classification tasks, particularly in scenarios where both performance and system reliability are critical. This research contributes to the field by demonstrating the feasibility of implementing robust fault tolerance in machine learning systems without compromising accuracy while also providing comprehensive performance comparisons across different model architectures and dataset complexities. The developed framework serves as a foundation for building more reliable machine-learning systems for real-world applications.

Image classification is a highly significant field in machine learning (ML), especially when applied to address longstanding and challenging issues in the biological sciences, such as specie recognition and biodiversity conservation. In this study, we present the development of a hybrid machine learning-based tool suitable for deployment on mobile devices. This tool is aimed at processing and classifying three-dimensional samples of endemic lizard species from the Amazon rainforest. The dataset used in our experiment was collected at the Museu Paraense Emílio Goeldi (MPEG), Belém-PA, Brazil, and comprises three species: (a) Anolis fuscoauratus; (b) Hoplocercus spinosus; and (c) Polychrus marmoratus. We compared the effectiveness of four artificial neural networks (ANN) for feature extraction: (a) MobileNet; (b) MobileNetV2; (c) MobileNetV3-Small; and (d) MobileNetV3-Large. Additionally, we evaluated five classical ML models for classifying the extracted patterns: (a) Support Vector Machine (SVM); (b) GaussianNB (GNB); (c) AdaBoost (ADB); (d) K-Nearest Neighbors (KNN); and (e) Random Forest (RF). The performance metrics of all classifiers were very close, we used the McNemar’s test on each model’s confusion matrix to evaluate and compare their statistical significance. Our best model was a combination of a 2.9 million parameters MobileNetV3-Small as the feature extractor, with a linear kernel-based SVM as the classifier, which achieved accuracy of 0.955, precision of 0.948, recall of 0.948, and f1-score of 0.948. The results indicated that the use of a small deep learning (DL) model, in combination with a classical ML algorithm, emerges as a viable technique for classifying three-dimensional representations of lizard species samples. Such an approach facilitates taxonomic identification work for professionals in the field and provides a tool adaptable for integration into mobile data recording equipment, such as smartphones, and benefiting from more morphological features extracted from three-dimensional samples instead of two-dimensional images.

In brain–computer interfaces (BCIs), it is crucial to process brain signals to improve the accuracy of the classification of motor movements. Machine learning (ML) algorithms such as artificial neural networks (ANNs), linear discriminant analysis (LDA), decision tree (D.T.), K-nearest neighbor (KNN), naive Bayes (N.B.), and support vector machine (SVM) have made significant progress in classification issues. This paper aims to present a signal processing analysis of electroencephalographic (EEG) signals among different feature extraction techniques to train selected classification algorithms to classify signals related to motor movements. The motor movements considered are related to the left hand, right hand, both fists, feet, and relaxation, making this a multiclass problem. In this study, nine ML algorithms were trained with a dataset created by the feature extraction of EEG signals.The EEG signals of 30 Physionet subjects were used to create a dataset related to movement. We used electrodes C3, C1, CZ, C2, and C4 according to the standard 10-10 placement. Then, we extracted the epochs of the EEG signals and applied tone, amplitude levels, and statistical techniques to obtain the set of features. LabVIEW™2015 version custom applications were used for reading the EEG signals; for channel selection, noise filtering, band selection, and feature extraction operations; and for creating the dataset. MATLAB 2021a was used for training, testing, and evaluating the performance metrics of the ML algorithms. In this study, the model of Medium-ANN achieved the best performance, with an AUC average of 0.9998, Cohen’s Kappa coefficient of 0.9552, a Matthews correlation coefficient of 0.9819, and a loss of 0.0147. These findings suggest the applicability of our approach to different scenarios, such as implementing robotic prostheses, where the use of superficial features is an acceptable option when resources are limited, as in embedded systems or edge computing devices.

A novel online tool condition monitoring method for milling titanium alloy with consideration of tool wear law

Freshwater ecosystems play a crucial role in maintaining ecological balance and supporting biodiversity. Assessing water quality and identifying pollution factors affected by seasonal changes is of utmost importance. The traditional approach for identifying pollution sources and seasonal water quality assessment is often labor-intensive, time-consuming, and complex. In response, our study introduces a hybrid receptor, multivariate statistical and machine learning (ML) based framework as an alternative. Positive matrix factorization (PMF) and receptor model were used to identify key pollutant sources, while Principal Component Analysis (PCA) was used to corroborate pollutant sources. Additionally, various supervised ML classification algorithms are used to predict and identify pollution sources on full physicochemical datasets and reduced in situ parameter scenarios. ML model stability and generalization capacity were evaluated using learning curves, cross-validation method. The findings indicate significant seasonal variability in water quality index, ranging from 38.5 (poor) to 78.6 (good). PMF and PCA revealed three dominant pollution factors, such as biogeochemical processes, sediment resuspension/nutrient influx, and anthropogenic pollution, affecting the seasonal water quality by 15-30%, 25-45%, and 40-70%, respectively. Model performance indicators using confusion matrices, ROC-AUC, and other evaluation metrics, for full dataset identified XGBoost as the best model, achieving the highest accuracy of 96.3%, followed by CatBoosting (93.6%), Random Forest (93.6%), Support Vector Classifier (91.8%), K-Nearest Neighbors (87.2%) and Decision Tree (84.3%). However, with the in situ data the ML models show stable and consistent classification accuracy in the range of approximately 70-81%. Overall, the modelling framework provides an effective approach for capturing seasonal variability and pollution source attribution, contributing to improved ecological understanding and predictive management of freshwater system.

Colon cancer is cancer that is present on the inner side of colon walls or the rectum walls in the large intestine. Most of these types of cancer begin as abnormal growth of tissue called as polyp. Colonography uses low dose radiation Computed tomography (CT) scanning to obtain an interior view of the colon making use of special x-ray machine to view the large intestine for cancer and abnormal growths known as polyps. Radiologists examine these images to find polyp like structure using computer tools. As CT Colonography image contain noise such as lungs, small intestine, instruments during image capturing; segmenting colon from noise is the key task. Polyp occurrence can be detected mainly using shape feature; eliminating shapes similar to polyp is challenging. Hence, to tackle above issues, Image processing techniques are used by applying deep learning algorithm - Convolution Neural Network (CNN) and the results are compared with classical machine learning algorithm. In proposed method, each image is pre-processed to filter air filled dark region that includes colon, lungs etc. Next, each pre-processed CT Image separated into fixed number of blocks. Using pre-trained CNN, each block of ROI is classified as Type 1 (Usually Ascending and descending colon), Type 2 (Usually Traversal and sigmoidal colon) and Type3 (Noise such as lungs, instruments) to segment colon blocks by eliminating noise. Classified Blocks is further diagnosed for polyp like structure using pre-trained CNN by classifying each colon block as normal or abnormal. The experiment is setup with classical machine learning algorithms - Random Forest (RF) and k-nearest neighbor (KNN) by extracting texture feature - Local binary pattern (LBP) and shape feature - Histogram oriented gradient (HOG) for comparison. The experiment results showed the accuracy of proposed method for colon segmentation using CNN (87%) outperforms RF (85%) and KNN (83%). In, addition, the polyp detection accuracy of CNN (88%) is better than Random forest (85%) and KNN (80%). Hence, in the proposed method, there is significant accuracy improvement using deep learning algorithm compared to classical machine learning algorithms. It also provide baseline for automated colon cancer diagnosis using Deep learning algorithms for further research.

Maize kernel traits such as kernel length, kernel width, and kernel number determine the total kernel weight and, consequently, maize yield. Therefore, the measurement of kernel traits is important for maize breeding and the evaluation of maize yield. There are a few methods that allow the extraction of ear and kernel features through image processing. We evaluated the potential of deep convolutional neural networks and binary machine learning (ML) algorithms (logistic regression (LR), support vector machine (SVM), AdaBoost (ADB), Classification tree (CART), and the K-Neighbor (kNN)) for accurate maize kernel abortion detection and classification. The algorithms were trained using 75% of 66 total images, and the remaining 25% was used for testing their performance. Confusion matrix, classification accuracy, and precision were the major metrics in evaluating the performance of the algorithms. The SVM and LR algorithms were highly accurate and precise (100%) under all the abortion statuses, while the remaining algorithms had a performance greater than 95%. Deep convolutional neural networks were further evaluated using different activation and optimization techniques. The best performance (100% accuracy) was reached using the rectifier linear unit (ReLu) activation procedure and the Adam optimization technique. Maize ear with abortion were accurately detected by all tested algorithms with minimum training and testing time compared to ear without abortion. The findings suggest that deep convolutional neural networks can be used to detect the maize ear abortion status supplemented with the binary machine learning algorithms in maize breading programs. By using a convolution neural network (CNN) method, more data (big data) can be collected and processed for hundreds of maize ears, accelerating the phenotyping process.

Machine learning today becomes more and more effective instrument to solve many particular problems, where there are difficulties to apply well known and described math model. In other words - it is a great tool to describe nonlinear phenomena. We tried to use this technique to improve existing process of stratigraphy and lithology interpretation and reduce costs on site by applying computer leaded predictions on the basis of existing on-field collected data. Article describes usage of machine learning algorithms for several geology data stratigraphy and lithology boundaries classification based on geophysics logging data for deposits in Kazakhstan. Correct marking of stratigraphy and lithology from geophysics logging data is complex non-linear task. To solve this task we applied several algorithms of machine learning: random forest, logistic regression, gradient boosting (scikit-learn library), k - nearest neighbour (KNN) and XGBoost.

Handwritten character recognition represents a major challenge in the fields of pattern recognition and machine learning, it is more concerned especially in the case of regional languages like Kannada. Kannada, a prominent Dravidian script, poses distinct challenges because of its intricate character formations and diverse handwriting styles. This study introduces a method for identifying handwritten Kannada characters with the application of three machine learning algorithms: K-Nearest Neighbors (KNN), Convolutional Neural Networks (CNN), and Support Vector Machines (SVM). The dataset utilized comprises an extensive array of handwritten Kannada characters sourced from the Kaggle repository. Preprocessing techniques, including image standardization and noise reduction, which are implemented to enhance recognition accuracy. CNN is used for feature extraction as well as classification, while KNN and SVM serve for comparative evaluation. The performance of these models is assessed using metrics such as precision, accuracy, recall, and F1-score. Findings indicate that CNN surpasses KNN and SVM in recognition accuracy, highlights the advantages of deep learning in the classification of handwritten characters. Additionally, a web-based app which is developed using Django to facilitate real-time character recognition. This research significantly contributes to the progress of Optical Character Recognition in Kannada script, promoting advancements in digitization and automation.

In data mining and machine learning, feature selection is a crucial research area. The objective of feature selection is to solve the high dimensionality issue. In order to acquire the highest performance subset of the unique features without any change, it entails choosing the pertinent characteristics and eliminating the unrelated, identical, and noisy ones. This work compares the feature selection processes used by K-Nearest Neighbor (KNN), Linear Discriminant Analysis (LDA), Random Forest (RF), and Support Vector Machine (SVM) and among other procedures. Random Forest outperforms the other three methods in terms of performance, precision, and computational efficiency.

Image segmentation of brain low-grade glioma (LGG) magnetic resonance imaging (MRI) contributes tremendously to diagnosis, classification and treatment of the disease. A tangible, accurate, reliable and fast image segmentation technique is demanded in clinical diagnosis and research. The emerging machine learning technique has been demonstrated its unique capability in the field of medical image processing, including medical image segmentation. Support vector machine (SVM) and convolutional neural network (CNN) are two widely used machine learning methods. In this work, image segmentation tools based on SVM and CNN are developed and evaluated for brain LGG MR image segmentation studies. The segmentation performance in terms of accuracy and cost is quantitatively analyzed and compared between the SVM and CNN techniques developed. Computed on the Google CoLab, each of the 109 SVM models represents an individual patient, is trained using a single image of that patient and takes a few seconds to complete. The CNN model is trained on a drastically larger dataset of 19,760 data augmented images and takes approximately 2 hours to obtain the most optimal result. The SVM models achieved an average and median accuracy of 0.937 and 0.976 respectively, precision of 0.456 and 0.535 respectively, recall of 0.878 and 0.906 respectively, and F1 score of 0.546 and 0.662 respectively. Although the CNN model required a significantly longer calculation time, it surpassed the SVM models in performance in LGG MR image segmentation, achieving an accuracy of 0.998, a precision of 0.999, a recall of 0.999 and an F1 score of 0.999. This study shows that SVM with appropriate filtering techniques is capable of obtaining reliable and fast segmentation of brain LGG MR images with sufficient accuracy and limited image data. CNN technique outperforms SVM in the accuracy of segmentation with requirements of significantly enlarged data set, long computation time and high-performance computer.

The rapid growth of financial technology (fintech) services in Indonesia has significantly transformed digital transaction behavior, with digital wallets such as DANA becoming widely adopted. Despite high usage rates, public discourse on social media frequently highlights both positive experiences and recurring concerns related to system reliability and data security. Twitter, as a real-time public communication platform, provides a rich source of user-generated content that reflects public perception toward fintech services. This study investigates public sentiment toward DANA fintech services in Indonesia through sentiment analysis of Twitter data using machine learning approaches. Purpose:This study aims to analyze public perception of DANA fintech services based on sentiment expressed on Twitter and to compare the performance of several machine learning classification algorithms in identifying positive, neutral, and negative sentiments in Indonesian-language social media texts. Methods/Study design/approach: The study employs a quantitative descriptive approach using text mining and sentiment analysis techniques. Twitter data were collected via the Twitter API over a specified period and processed through preprocessing stages including text cleaning, tokenization, stopword removal, and stemming. Feature extraction was performed using the Term Frequency–Inverse Document Frequency (TF-IDF) method. Sentiment classification was conducted using Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Random Forest algorithms. Model performance was evaluated using accuracy, precision, recall, and F1-score metrics. Result/Findings:The results indicate that public sentiment toward DANA is predominantly positive, driven by perceptions of transaction convenience and speed, followed by neutral sentiment, while negative sentiment is mainly associated with system disruptions and data security issues. Among the evaluated algorithms, SVM achieved the highest classification accuracy (91.4%), outperforming Random Forest and KNN. These findings demonstrate that SVM is more effective for sentiment classification of short Indonesian-language texts on social media platforms. Novelty/Originality/Value:This study contributes to the growing body of sentiment analysis research in Indonesia by providing empirical evidence on public perception of fintech services using machine learning techniques. By systematically comparing multiple classification algorithms in the context of Indonesian Twitter data, the study offers methodological insights and practical implications for fintech service providers in improving service quality, communication strategies, and user trust.

Emotion recognition plays a pivotal role in advancing Human-Computer Interaction (HCI) by enabling systems to understand and respond to human emotional states. Among various modalities, Speech Emotion Recognition (SER) stands out as a non-invasive, cost-effective, and temporally efficient approach for detecting emotions. This study leverages the RAVDESS dataset, which provides high-quality audio recordings for emotion classification. The proposed methodology involves preprocessing audio signals to remove noise, extracting temporal and spectral features in both time and frequency domains, and implementing machine learning models for multi-class emotion classification. The study evaluates and compares the performance of several classification models, including Random Forest (RF), Multilayer Perceptron (MLP), Support Vector Machine (SVM), Convolutional Neural Networks (CNN), and Decision Trees (DT). Experimental results demonstrate promising accuracy levels, highlighting the potential of these machine learning techniques in SER. This research contributes to the integration of SER within Brain-Computer Interfaces (BCI) and other emotion-aware applications, paving the way for enhanced interactive systems. Keywords – Speech Emotion Recognition -Machine Learning - Random Forest -Multilayer Perceptron - Support Vector Machine - Convolutional Neural Networks - Decision Tree - RAVDESS Dataset

The prediction of wind energy generation is important to enhance the performance and dependability of renewable energy systems due to the rising demand for wind-generated electricity and advancements in wind energy technology competitiveness. This study leverages advanced machine learning (ML) and some other statistical and deep learning based time series forecasting models to enhance the accuracy of wind energy predictions. This comprehensive analysis includes nine ML models—Linear Regression, Random Forests (RF), Gradient Boosting Machines (GBM), Support Vector Machines (SVM), K-Nearest Neighbors (KNN), AdaBoost, XGBoost, Support Vector Regression (SVR), and Neural Networks—as well as Four time-series forecasting models—ARIMA, Temporal Convolutional Networks (TCNs), Long Short-Term Memory (LSTM) networks and GRU. Each ML model underwent rigorous cross-validation to ensure optimal performance. The assessment criteria utilized here comprised the Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error (MAE), and the R² Score. It was found that among the nine ML models, Random Forests, GBM and KNN consistently provided superior accuracy and robustness, making them the top choices for wind energy prediction whereas the performance of linear regression, SVM and SVR were very poor for the considered dataset. From the experiment, Random Forest, GBM, and KNN showed the best performance with low MSE values of 0.77, 1.95, and 1.51 respectively, while other models had MSEs above 7.5, with AdaBoost reaching 30. Their RMSEs (0.88, 1.40, 1.23) and MAEs (0.093, 0.73, 0.10) also indicate strong predictive accuracy compared to the rest.In this paper, time series forecasting, TCNs, LSTM and GRU networks showed strong capabilities in capturing temporal dependencies and trends within the wind energy data. Visualization techniques were employed to compare model performances comprehensively, providing clear insights into their predictive power. Therefore, this present study offers a robust framework for researchers and practitioners aiming to leverage machine learning and time series forecasting in the realm of renewable energy prediction.