A Classification Method for Maize Leaf Disease Based on SimCLR and Triplet Attention

Most popular image classification methods mainly focus on classification ability rather than recognizing new things. However, human lay emphasis on cognition first and then classification, which is closely related to human memory system. Though many memory models have been proposed, they are studied in word list whereas the reports about natural images are still limited. This paper proposes a memory model for image recognition and classification based on convolutional neural network and Bayesian decision. First the image feature is extracted by convolutional neural network and stored in binary form. Then the representation, storage and retrieval processes of visual images are modeled. The test image feature vector is matched in parallel to the studied image vectors, and the likelihood values are calculated. Finally, the odd that the test image belongs to a new class is computed based on all likelihood values. If the odd value is greater than a certain threshold, the test image is regarded as new; otherwise, the Bayesian decision rule for image classification is performed. Experimental results on Caltech-101 and Caltech-256 datasets show that the proposed method can perform well in image recognition and classification tasks. And the hit probability of the method is higher than two typical methods, SRC and ELM, at present while the false alarm rate is far lower than them.

Maize leaf disease recognition based on improved MSRCR and OSCRNet

Deep Neural Network (DNN) models are widely used for image classification. While they offer high performance in terms of accuracy, researchers are concerned about if these models inappropriately make inferences using features irrelevant to the target object in a given image. To address this concern, we propose a metamorphic testing approach that assesses if a given inference is made based on irrelevant features. Specifically, we propose two metamorphic relations (MRs) to detect such unreliable inferences. These relations expect (a) the classification results with different labels or the same labels but less certainty from models after corrupting the relevant features of images, and (b) the classification results with the same labels after corrupting irrelevant features. The inferences that violate the metamorphic relations are regarded as unreliable inferences. Our evaluation demonstrated that our approach can effectively identify unreliable inferences for single-label classification models with an average precision of 64.1% and 96.4% for the two MRs, respectively. As for multi-label classification models, the corresponding precision for MR-1 and MR-2 is 78.2% and 86.5%, respectively. Further, we conducted an empirical study to understand the problem of unreliable inferences in practice. Specifically, we applied our approach to 18 pre-trained single-label image classification models and 3 multi-label classification models, and then examined their inferences on the ImageNet and COCO datasets. We found that unreliable inferences are pervasive. Specifically, for each model, more than thousands of correct classifications are actually made using irrelevant features. Next, we investigated the effect of such pervasive unreliable inferences, and found that they can cause significant degradation of a model’s overall accuracy. After including these unreliable inferences from the test set, the model’s accuracy can be significantly changed. Therefore, we recommend that developers should pay more attention to these unreliable inferences during the model evaluations. We also explored the correlation between model accuracy and the size of unreliable inferences. We found the inferences of the input with smaller objects are easier to be unreliable. Lastly, we found that the current model training methodologies can guide the models to learn object-relevant features to certain extent, but may not necessarily prevent the model from making unreliable inferences. We encourage the community to propose more effective training methodologies to address this issue.

When utilizing convolutional neural networks for wheat disease identification, the training phase typically requires a substantial amount of labeled data. However, labeling data is both complex and costly. Additionally, the model’s recognition performance is often disrupted by complex factors in natural environments. To address these issues, this paper proposes a wheat disease identification model, SC-ConvNeXt, which integrates the SimCLR pre-training framework and an improved CBAM attention mechanism. The model employs ConvNeXt-T as the feature extraction network. Initially, it uses the self-supervised SimCLR pre-training framework to learn inter-class similarities, reducing the reliance on labeled data during training. Subsequently, the CBAM attention module is integrated into ConvNeXt-T to enhance the model’s feature extraction and generalization capabilities in complex backgrounds, and each attention module’s loss function is improved with a LeakyReLU activation function to prevent neuron deactivation when inputs are negative. Furthermore, by introducing the Focal Loss function, the model addresses the imbalance in the quantity of easy and difficult-to-classify samples. The dataset used in this study comes from the ‘Smart Agriculture’ platform of Jilin Agricultural Science and Technology College, including images of three wheat diseases and healthy wheat. After expanding the dataset with various data augmentation methods, the effectiveness of adding SimCLR and the attention mechanism was sequentially verified. Comparative experiments were also conducted against four classic classification models. The experimental results show that the proposed SC-ConvNeXt model achieves an average classification accuracy of 88.05% on the test set, the highest among all comparative models. The model does not require additional labeled data during training, demonstrating its effectiveness in enhancing wheat disease recognition performance under natural environmental conditions without the need for extra labeled data training.

The classification of marine plankton images is of great significance in ecological studies and environmental monitoring. In practical applications, plankton image classification faces several challenges, including sample imbalance, distinguishing between-class and within-class differences, and recognizing fine-grained features. To address these issues, we propose a few-shot self-supervised transfer learning (FSTL) framework. In FSTL, we design a new loss function that incorporates both supervised and self-supervised learning. The core of FSTL is a hybrid learning objective that integrates self-supervised contrastive learning for robust feature representation. Operating within a transfer learning paradigm, FSTL effectively adapts knowledge from head-classes to boost the few-shot classification performance on tail-classes. We applied FSTL to two datasets, in which plankton images were collected from Daya Bay and provided by the Woods Hole Oceanographic Institution (WHOI) datasets respectively. The experimental results demonstrated that our method showed better adaptability in the classification of plankton images. The findings of this study not only apply to the classification of plankton images but also offer the potential for classifying small-sample categories within long-tailed datasets.

Automated classification of histopathological images is an important research problem in medical imaging. Digital histopathology exhibits two principally distinct characteristics: 1) invariably histopathological images are multi-channel (color) with key geometric information spread across the color channels instead of being captured by luminance alone, and 2) the richness of geometric structures in such tissue imagery makes feature extraction for classification very demanding. Inspired by recent work in the use of sparsity for single channel image classification, we propose a new simultaneous Sparsity model for multi-channel Histopathological Image Representation and Classification (SHIRC). Essentially, we represent a multi-channel histopathological image as a sparse linear combination of training examples under suitable channel-wise constraints and classification is performed by solving a newly formulated simultaneous sparsity-based optimization problem. Experiments on two challenging real-world image databases: 1) provided by pathologists of the Animal Diagnostics Lab (ADL) at Pennsylvania State University, and 2) histopathological images corresponding to intraductal breast lesions [1], reveal the merits of the proposed SHIRC model over state of the art alternatives.

Deep learning-based image classification for online multi-coal and multi-class sorting

A probabilistic topic model using deep visual word representation for simultaneous image classification and annotation

Precision agriculture requires accurate discrimination between winter crops and weeds, but there is a lack of annotated image data for winter cropping systems. This paper investigates a two-stage deep learning approach that integrates self-supervised feature learning with supervised fine-tuning for winter crop and weed image classification. A new winter crop and weed image dataset, WinterCropWeedDB, is proposed and used in this paper, which contains 1,136 high-resolution images of six winter crop species and four weed species collected from agricultural fields in central India. In the first stage of self-supervised learning, an EfficientNet-B3 model is pre-trained using a SimCLR-style self-supervised learning approach with an InfoNCE loss function (temperature τ = 0.5) on the images. The average contrastive loss value reduces from 2.0712 in the first iteration to 1.6835 at the end of pretraining. In the second stage of supervised fine-tuning, the pre-trained EfficientNet-B3 model is fine-tuned with a supervised classifier head on the images and tested on a single internal validation split (30%) of the dataset. The fine-tuned model reaches a maximum validation accuracy of 98.27%, with a macro-averaged F1-score of 0.98. Gradient-weighted class activation mapping (Grad-CAM) and Grad-CAM++ are used on the fine-tuned model to provide a qualitative visualization of the image regions that contribute to class predictions. The experiment outcomes demonstrate the viability of using self-supervised pretraining and supervised fine-tuning for the classification of winter crop and weed images on a region-specific dataset, while also emphasizing the importance of additional testing on independent test sets.

The advancement of automated medical diagnosis in biomedical engineering has become an important area of research. Image classification is one of the diagnostic approaches that do not require segmentation which can draw quicker inferences. The proposed non-invasive diagnostic support system in this study is considered as an image classification system where the given brain image is classified as normal or abnormal. The ability of deep learning allows a single model for feature extraction as well as classification whereas the rational models require separate models. One of the best models for image localization and classification is the Visual Geometric Group (VGG) model. In this study, an efficient modified VGG architecture for brain image classification is developed using transfer learning. The pooling layer is modified to enhance the classification capability of VGG architecture. Results show that the modified VGG architecture outperforms the conventional VGG architecture with a 5% improvement in classification accuracy using 16 layers on MRI images of the REpository of Molecular BRAin Neoplasia DaTa (REMBRANDT) database.

In Health Care, the medical image processing becomes a necessary marathon for the Computer Aided Diagnostic (CAD) systems. Blobs are the heterogeneous small parts of an image, which helps in finding and locating the abnormalities and damages of the body organs from the digital medical images. For the disease early diagnosis and staging purpose, the blobs’ location, size, shape, center and radius like properties should be calculated from the medical images. As on, many former researchers were proposed several blob detections models and algorithms to accurately find the blobs from the medical images. Although many researchers proposed various blob detection models, they are still facing several limitations in detection, due to the indistinct boundaries and the diversity in shape and distribution of the blobs. As part of the research on blob detection, in this survey paper we are presenting the essential information regarding the medical image blob detection and classification models.

We propose self-adaptive training-a unified training algorithm that dynamically calibrates and enhances training processes by model predictions without incurring an extra computational cost-to advance both supervised and self-supervised learning of deep neural networks. We analyze the training dynamics of deep networks on training data that are corrupted by, e.g., random noise and adversarial examples. Our analysis shows that model predictions are able to magnify useful underlying information in data and this phenomenon occurs broadly even in the absence of any label information, highlighting that model predictions could substantially benefit the training processes: self-adaptive training improves the generalization of deep networks under noise and enhances the self-supervised representation learning. The analysis also sheds light on understanding deep learning, e.g., a potential explanation of the recently-discovered double-descent phenomenon in empirical risk minimization and the collapsing issue of the state-of-the-art self-supervised learning algorithms. Experiments on the CIFAR, STL, and ImageNet datasets verify the effectiveness of our approach in three applications: classification with label noise, selective classification, and linear evaluation. To facilitate future research, the code has been made publicly available at https://github.com/LayneH/self-adaptive-training.

Review on self-supervised image recognition using deep neural networks

Across the globe, dyslexia and dysgraphia are two frequent learning disorders identified in classrooms. This condition is characterized by difficulties in age-appropriate reading without any sociocultural restrictions. Children with this disorder have difficulty recognizing word and letter patterns. Early identification of dyslexic children (DC) is crucial for providing them with the most effective educational opportunities. Researchers proposed a deep learning-based dyslexia detection system (DDS). However, there is a demand for a practical, lightweight framework for identifying DC. Thus, the proposed study intends to build a framework for detecting dyslexia. The proposed framework encompasses image processing, feature extraction, and classification models. The image-processing model enhances the image quality using contrast-limited adaptive histogram equalization and resizes the images into 512 × 512 pixels. For feature extraction, the authors employ you only look once V7 to extract features in a limited time. In addition, the MobileNet V2 with single shot detection lite is used to classify the handwritten images into normal and abnormal classes, respectively. The authors utilized the publicly available dyslexia dataset for performance evaluation. The test set contains 19,557 normal and 17,882 reversal (abnormal) images. The baseline models are employed for comparative analysis. The experimental study revealed that the proposed framework outperformed the baseline models by achieving exceptional precision, recall, F1-Score, accuracy, and mean average precision of 97.9, 97.3, 97.6, 99.2, and 97.6, respectively. In addition, the proposed model obtained an exceptional mean intersection over union of 88.6. It can be implemented in educational institutions and healthcare centers. In the future, the authors can extend the research to build an integrated framework using biomedical images.

The aim of this study was to distinguish canine lymphoma from other diseases,particularly reactive lymphoid hyperplasia (RLH), based on fine needle aspiration (FNA)images. We developed four deep learning models based on Vision Transformer (ViT) andInception-v3, which were pre-trained image classification models. The two models out offour were ViT and Inception-v3, and the remained were the two types of combination, i.e.,ensemble learning models, of ViT and Inception-v3; the mean of class probabilities of ViTand Inception-v3 (Ensemble model A; MEAN) and the maximum probabilities of ViT andInception-v3 (Ensemble model B; MAX). A total of 2,290 FNA images of canine lymphoma and871 FNA images of RLH were analyzed. The FNA images were obtained from the twenty-fiveslides of fourteen lymphoma cases and eight slides of seven RLH cases in two hospitals.Three types of training and test datasets were prepared from the above image datasets forfair evaluation of the models. Three deep learning-based image classification models(Inception-v3 and the two ensemble models) attained high performance of >80% accuracy,recall and area under the curve (AUC) values for all three datasets. ViT did not archivehigh performance, except the precision (>0.85). This study is an example of showingpotentials of deep learning models through image classification problem in caninelymphoma.