Trust, Interruption, and Workload in Multi-AUV Control: Part 2 – Image Classification and Human-AI Benchmarking

Image classification is critical in computer vision, with numerous applications ranging from e-commerce to medical imaging. This study provides a comprehensive evaluation of traditional machine learning algorithms for image classification, implementing and analysing novel fault tolerance mechanisms amongst these algorithms. The authors compared the performance of K-Nearest Neighbors (KNN), Decision Trees, Random Forest, and XGBoost on both Fashion MNIST and CIFAR-10 datasets. The comparison was extended to include Support Vector Machine (SVM), Logistic Regression, and Naive Bayes classifiers in order to expand the evaluation of these models on the indicated datasets. Key findings demonstrated the superiority of ensemble methods, particularly XGBoost, which achieved 89.31% of accuracy on Fashion MNIST and 54.93% on CIFAR-10, consistently outperforming other models across various configurations. Random Forest exhibited robust performance as the secondbest model, reaching 87.42% and 51.64% of accuracy on the respective datasets. The significant performance gap between datasets demonstrated the challenges that traditional machine learning models face with complex image data. Implementing the fault tolerance framework in this study has also shown a remarkable effectiveness, achieved a 94.6% recovery rate while maintaining model accuracy within 0.1% of standard implementations. This was achieved with minimal computational overhead (2.3% of training time and 1.8% of memory usage), making it highly practical for production deployments. The system significantly reduced operational failures, decreasing crashes from 5.2 to 0.3 per day and increasing average uptime from 4.3 to 12.0 hours. The study also reveals important insights regarding model scalability and resource requirements, with memory usage varying significantly across models (325MB to 8,923MB). These findings provide valuable guidance for practitioners in selecting and implementing machine learning models for image classification tasks, particularly in scenarios where both performance and system reliability are critical. This research contributes to the field by demonstrating the feasibility of implementing robust fault tolerance in machine learning systems without compromising accuracy while also providing comprehensive performance comparisons across different model architectures and dataset complexities. The developed framework serves as a foundation for building more reliable machine-learning systems for real-world applications.

Image classification is getting more attention in the area of computer vision. During the past few years, a lot of research has been done on image classification using classical machine learning and deep learning techniques. Presently, deep learning-based techniques have given stupendous results. The performance of a classification system depends on the quality of features extracted from an image. The better is the quality of extracted features, the more the accuracy will be. Although, numerous deep learning-based methods have shown enormous performance in image classification, still due to various challenges deep learning methods are not able to extract all the important information from the image. This results in a reduction in overall classification accuracy. The goal of the present research is to improve the image classification performance by combining the deep features extracted using popular deep convolutional neural network, VGG19, and various handcrafted feature extraction methods, i.e., SIFT, SURF, ORB, and Shi-Tomasi corner detector algorithm. Further, the extracted features from these methods are classified using various machine learning classification methods, i.e., Gaussian Naïve Bayes, Decision Tree, Random Forest, and eXtreme Gradient Boosting (XGBClassifier) classifier. The experiment is carried out on a benchmark dataset Caltech-101. The experimental results indicate that Random Forest using the combined features give 93.73% accuracy and outperforms other classifiers and methods proposed by other authors. The paper concludes that a single feature extractor whether shallow or deep is not enough to achieve satisfactory results. So, a combined approach using deep learning features and traditional handcrafted features is better for image classification.

Advancements in the implementation of quantum hardware have enabled the acquisition of data that are intractable for emulation with classical computers. The integration of classical machine learning (ML) algorithms with these data holds potential for unveiling obscure patterns. Although this hybrid approach extends the class of efficiently solvable problems compared to using only classical computers, this approach has been only realized for solving restricted problems because of the prevalence of noise in current quantum computers. Here, we extend the applicability of the hybrid approach to problems of interest in many-body physics, such as predicting the properties of the ground state of a given Hamiltonian and classifying quantum phases. By performing experiments with various error-reducing procedures on superconducting quantum hardware with 127 qubits, we managed to acquire refined data from the quantum computer. This enabled us to demonstrate the successful implementation of theoretically suggested classical ML algorithms for systems with up to 44 qubits. Our results verify the scalability and effectiveness of the classical ML algorithms for processing quantum experimental data.

Remote cameras have become a widespread data‐collection tool for terrestrial mammals, but classifying images can be labor intensive and limit the usefulness of cameras for broad‐scale population monitoring. Machine learning algorithms for automated image classification can expedite data processing, but image misclassifications may influence inferences. Here, we used camera data for three sympatric species with disparate body sizes and life histories – black‐tailed jackrabbits (Lepus californicus), kit foxes (Vulpes macrotis), and pronghorns (Antilocapra americana) – as a model system to evaluate the influence of competing image classification approaches on estimates of occupancy and inferences about space use. We classified images with: (i) single review (manual), (ii) double review (manual by two observers), (iii) an automated‐manual review (machine learning to cull empty images and single review of remaining images), (iv) a pretrained machine‐learning algorithm that classifies images to species (base model), (v) the base model accepting only classifications with ≥95% confidence, (vi) the base model trained with regional images (trained model), and (vii) the trained model accepting only classifications with ≥95% confidence. We compared species‐specific results from alternative approaches to results from double review, which reduces the potential for misclassifications and was assumed to be the best approximation of truth. Despite high classification success, species‐level misclassification rates for the base and trained models were sufficiently high to produce erroneous occupancy estimates and inferences related to space use across species. Increasing the confidence thresholds for image classification to 95% did not consistently improve performance. Classifying images as empty (or not) offered a reasonable approach to reduce effort (by 97.7%) and facilitated a semi‐automated workflow that produced reliable estimates and inferences. Thus, camera‐based monitoring combined with machine learning algorithms for image classification could facilitate monitoring with limited manual image classification.

Extracting image feature points and classification methods is the key of content-based image classification. In this paper, SIFT(Scale-invariant feature transform) algorithm is used to extract feature points, all feature points extracted are clustered by K-means clustering algorithm, and then BOW(bag of word) of each image is constructed. Finally, SVM(Support Vector Machine) is used to train a multi-class classifier to classify images. The SIFT algorithm has a strong tolerance for scaling, rotation, brightness changes, and noise. The k-means algorithm is simple in structure and fast in convergence. SVM can get better results in small sample training set and has excellent generalization ability. Experimental results show that the accuracy of image classification in the above methods is about 90%.

Deep learning-based image classification for online multi-coal and multi-class sorting

Machine learning today becomes more and more effective instrument to solve many particular problems, where there are difficulties to apply well known and described math model. In other words - it is a great tool to describe nonlinear phenomena. We tried to use this technique to improve existing process of stratigraphy and lithology interpretation and reduce costs on site by applying computer leaded predictions on the basis of existing on-field collected data. Article describes usage of machine learning algorithms for several geology data stratigraphy and lithology boundaries classification based on geophysics logging data for deposits in Kazakhstan. Correct marking of stratigraphy and lithology from geophysics logging data is complex non-linear task. To solve this task we applied several algorithms of machine learning: random forest, logistic regression, gradient boosting (scikit-learn library), k - nearest neighbour (KNN) and XGBoost.

Despite the promise for performance and accuracy improvements of quantum inspired (QI) algorithms over classical machine learning (ML) algorithms, such gains have not been realized in practice. The quantum inspired algorithms can theoretically achieve significant speed up based on sampling assumptions and have thus far failed to outperform the existing classical ML models in practical applications. The speedup of quantum machine learning (QML) algorithms assume the access to data in quantum random access memory (QRAM) which is a strong assumption with current quantum architectures. QI algorithms assume sample and query (SQ) access to input vector and norms of matrices using a dynamic data structure. We explore the components of these models and the assumptions in this paper by surveying the recent works in QML and QI Machine learning (QIML) algorithms. We limit our study to QML and QIML models on achieving a speed up over classical ML techniques rather than individual proofs of these algorithms. This study highlights the assumptions being made that are currently not practical for QML and QIML algorithms in achieving performance advantage over classical ML algorithms.

Image classification technology has made significant advancements, but methods tailored for specific image classification, such as sport image, remain inadequate. This is primarily constrained by two factors. First, the image quality of sport images varies greatly, and many rare sports have very few images. Second, most sport image classification techniques directly transfer image classification methods from other domains, with few approaches specifically designed based on the unique features of sport images. To address this problem, we devise a Frequency-domain Guided sport image classification method with Large model Assistance, named FGLA. Specifically, we design two main modules for FGLA. The first module combines Fourier Transform and Wavelet Transform to embed the frequency-domain information into the original image as additional channels, which converts the image into a three-dimensional cuboid, incorporating more comprehensive information. This allows the model to assign different weights to each channel, thereby enhancing image classification performance. The second module leverages the powerful image generation capabilities of large models to augment the dataset with more images, especially for rare sports. Additionally, it directly generates frequency-domain images to enhance the generalization of the classification model. We analyze the effectiveness of FGLA across many models and several classic sports datasets. The results indicate that FGLA achieves the highest accuracy in sport image classification. Moreover, this method also demonstrates strong generalization capabilities and can be adapted to other image classification tasks.

Image classification is a highly significant field in machine learning (ML), especially when applied to address longstanding and challenging issues in the biological sciences, such as specie recognition and biodiversity conservation. In this study, we present the development of a hybrid machine learning-based tool suitable for deployment on mobile devices. This tool is aimed at processing and classifying three-dimensional samples of endemic lizard species from the Amazon rainforest. The dataset used in our experiment was collected at the Museu Paraense Emílio Goeldi (MPEG), Belém-PA, Brazil, and comprises three species: (a) Anolis fuscoauratus; (b) Hoplocercus spinosus; and (c) Polychrus marmoratus. We compared the effectiveness of four artificial neural networks (ANN) for feature extraction: (a) MobileNet; (b) MobileNetV2; (c) MobileNetV3-Small; and (d) MobileNetV3-Large. Additionally, we evaluated five classical ML models for classifying the extracted patterns: (a) Support Vector Machine (SVM); (b) GaussianNB (GNB); (c) AdaBoost (ADB); (d) K-Nearest Neighbors (KNN); and (e) Random Forest (RF). The performance metrics of all classifiers were very close, we used the McNemar’s test on each model’s confusion matrix to evaluate and compare their statistical significance. Our best model was a combination of a 2.9 million parameters MobileNetV3-Small as the feature extractor, with a linear kernel-based SVM as the classifier, which achieved accuracy of 0.955, precision of 0.948, recall of 0.948, and f1-score of 0.948. The results indicated that the use of a small deep learning (DL) model, in combination with a classical ML algorithm, emerges as a viable technique for classifying three-dimensional representations of lizard species samples. Such an approach facilitates taxonomic identification work for professionals in the field and provides a tool adaptable for integration into mobile data recording equipment, such as smartphones, and benefiting from more morphological features extracted from three-dimensional samples instead of two-dimensional images.

BackgroundDiffusion-weighted (DW) imaging is a well-recognized magnetic resonance imaging (MRI) technique that is being routinely used in brain examinations in modern clinical radiology practices. This study focuses on extracting demographic and texture features from MRI Apparent Diffusion Coefficient (ADC) images of human brain tumors, identifying the distribution patterns of each feature and applying Machine Learning (ML) techniques to differentiate malignant from benign brain tumors.MethodsThis prospective study was carried out using 1599 labeled MRI brain ADC image slices, 995 malignant, 604 benign from 195 patients who were radiologically diagnosed and histopathologically confirmed as brain tumor patients. The demographics, mean pixel values, skewness, kurtosis, features of Grey Level Co-occurrence Matrix (GLCM), mean, variance, energy, entropy, contrast, homogeneity, correlation, prominence and shade, were extracted from MRI ADC images of each patient. At the feature selection phase, the validity of the extracted features were measured using ANOVA f-test. Then, these features were used as input to several Machine Learning classification algorithms and the respective models were assessed.ResultsAccording to the results of ANOVA f-test feature selection process, two attributes: skewness (3.34) and GLCM homogeneity (3.45) scored the lowest ANOVA f-test scores. Therefore, both features were excluded in continuation of the experiment. From the different tested ML algorithms, the Random Forest classifier was chosen to build the final ML model, since it presented the highest accuracy. The final model was able to predict malignant and benign neoplasms with an 90.41% accuracy after the hyper parameter tuning process.ConclusionsThis study concludes that the above mentioned features (except skewness and GLCM homogeneity) are informative to identify and differentiate malignant from benign brain tumors. Moreover, they enable the development of a high-performance ML model that has the ability to assist in the decision-making steps of brain tumor diagnosis process, prior to attempting invasive diagnostic procedures, such as brain biopsies.

Although the consortium blockchains commonly adopt consensus algorithms with Byzantine fault tolerance (such as practical Byzantine fault tolerance (PBFT)), its consensus efficiency will be degraded by the existence of malicious nodes or behaviors. However, the existing researches mainly focus on the detection of malicious behaviors for public blockchains, but are rare about consortium blockchains. In this paper, an anomaly detection model based on machine learning (ML) classification algorithm is proposed for consortium blockchains that adopt PBFT. Besides, a two-stage process is proposed to reduce the resource consumption for anomaly detection. The data needed for proposed model only has two dimensions and is convenient to obtain. The results of experiment show that ML is very effective in anomaly detection for consortium blockchains. Specifically, the algorithms with the highest accuracy are convolutional neural networks (CNN), k-nearest neighbor (KNN) and support vector machines (SVM) in turn. However, KNN and SVM are more suitable because resource consumption of both algorithms are one third of CNN, and the accuracy rates are above 0.9 which is 0.9% lower than CNN.

In the realm of computer vision, image classification is a critical issue with many applications, including multimedia content analysis, security and surveillance, and medical imaging. The accuracy of image classification algorithms has considerably increased with the development of deep learning. The discipline of image classification has dramatically benefited from the usage of pre-trained Convolutional Neural Network (CNN) models. In this study, we perform image classification on the Wang dataset composed of 1000 images separated into ten categories, using six different pre-trained CNN models. The research made use of pre-trained versions of VGG16, Densenet, Mobilenet, Inception V3, Resnet50, and Xception models. We assessed the model performances in terms of training and testing accuracy. Testing accuracies for ten unique batches of data were calculated and averaged out. Densenet outperformed state-of-the-art models like Xception by a small margin, mainly due to low data availability. The findings of this study show how pre-trained models have advanced the field of image classification and shed light on how well these models perform in diverse image classification tasks. This study can serve as a valuable reference for researchers and practitioners in the field of computer vision and deep learning and help inform their choices when selecting pre-trained models for image classification, depending on their needs, while also considering data availability and computational constraints.

Image classification toward breast cancer using deeply-learned quality features

Bag of visual words model deriving from text categorization has recently appeared promising for object and image classification, this method always need to deal with large database. This paper proposed an efficient clustering algorithm to obtain universal codebook and adapted codebook, our combination of k-means and agglomerative clustering gives significant improvement in time efficiency while maintaining the same performance of image classification. We also use the adapted codebook to improve image classification performance, an image is presented by a set of histograms - one per class, each histogram describes whether the image is best modeled by the universal codebook or the corresponding adapted class codebook. The experiment result on Caltech-256 shows the combined universal codebook and adapted class codebook representation outperforms those approaches which use the universal codebook only.