Next generation insect taxonomic classification by comparing different deep learning algorithms

Interstitial lung disease (ILD) refers to a group of various abnormal inflammations of lung tissues and early diagnosis of these disease patterns is crucial for the treatment. Yet it is difficult to make an accurate diagnosis due to the similarity among the clinical manifestations of these diseases. In order to assist the radiologists, computer-aided diagnosis systems have been developed. Besides, the potential of deep convolutional neural networks (CNNs) is also expected to exert on the medical image analysis in recent years. In this paper, we design a new deep convolutional neural network (CNN) architecture to achieve the classification task of ILD patterns. Furthermore, we also propose a novel two-stage transfer learning (TSTL) method to deal with the problem of the lack of training data, which leverages the knowledge learned from sufficient textural source data and auxiliary unlabeled lung CT data to the target domain. We adopt the unsupervised manner to learn the unlabeled data, by which the objective function composed of the prediction confidence and mutual information are optimized. The experimental results show that our proposed CNN architecture achieves desirable performance and outperforms most of the state-of-the-art ones. The comparative analysis demonstrates the promising feasibility and advantages of the proposed two-stage transfer learning strategy as well as the potential of the knowledge learning from lung CT data. Graphical Abstract The framework of the proposed two-stage transfer learning method.

The assessment of bone age has applications in a wide variety of fields: from orthodontics to immigration. The traditional non-automated methods are time-consuming and subject to inter- and intra-observer variability. This is the first study of its kind done on the Indian population. In this study, we analyse different pre-processing techniques and architectures to determine the degree of maturation (i.e. cervical vertebral maturation [CVM]) from cephalometric radiographs using machine learning algorithms. Cephalometric radiographs-labelled with the correct CVM stage using Baccetti et al. method-from 383 individuals aged between 10 and 36 years were used in the study. Data expansion and in-place data augmentation were used to handle high data imbalances. Different pre-processing techniques like Sobel filters and canny edge detectors were employed. Several deep learning convolutional neural network (CNN) architectures along with numerous pre-trained models like ResNet-50 and VGG-19 were analysed for their efficacy on the dataset. Models with 6 and 8 convolutional layers trained on 64 × 64-size grayscale images trained the fastest and achieved the highest accuracy of 94%. Pre-trained ResNet-50 with the first 49 layers frozen and VGG-19 with 10 layers frozen to training had remarkable performances on the dataset with accuracies of 91% and 89%, respectively. Custom deep CNN models with 6-8 layers on 64 × 64-sized greyscale images were successfully used to achieve high accuracies to classify the majority classes. This study is a launchpad in the development of an automated method for bone age assessment from lateral cephalograms for clinical purposes.

Malignant melanoma is the deadliest form of skin cancer and, in recent years, is rapidly growing in terms of the incidence worldwide rate. The most effective approach to targeted treatment is early diagnosis. Deep learning algorithms, specifically convolutional neural networks, represent a methodology for the image analysis and representation. They optimize the features design task, essential for an automatic approach on different types of images, including medical. In this paper, we adopted pretrained deep convolutional neural networks architectures for the image representation with purpose to predict skin lesion melanoma. Firstly, we applied a transfer learning approach to extract image features. Secondly, we adopted the transferred learning features inside an ensemble classification context. Specifically, the framework trains individual classifiers on balanced subspaces and combines the provided predictions through statistical measures. Experimental phase on datasets of skin lesion images is performed and results obtained show the effectiveness of the proposed approach with respect to state-of-the-art competitors.

In this research work, a deep learning algorithm is applied to the medical domain to deliver a better healthcare system. For this, a deep learning framework for classification the region of interest pattern of complex hyperspectral medical images is proposed. The performance of computer‐aided diagnosis by verifying the region in hyperspectral image by pre and post‐cancerous region classification is enhanced. For this a deep Boltzmann machine (DBM) architecture of the bipartite structure as an unsupervised generative model was developed. The performance of DBM is compared with deep convolutional neural network architecture. For implementation, a three‐layer unsupervised network with a backpropagation structure is used. From the presented dataset, image patches are collected and classified into two classes, namely non‐informative and discriminative classes as labelled classes. The spatial information is used for classification and spectral‐spatial representation of class labels is formed. In the labelled classes, the accuracy, false‐positive predictions, sensitivity are obtained for the proposed fully‐connected network. By the proposed cognitive computation technique an accuracy of 95.5% with 93.5% sensitivity was obtained. From the obtained classification, accuracy and success rate DBM provide a better classification of complex images compared to traditional convolution network.

PurposeTo develop a deep network architecture that would achieve fully automatedradiologist-level segmentation of cancers at breast MRI.Materials and MethodsIn this retrospective study, 38 229 examinations (composed of64 063 individual breast scans from 14 475 patients) wereperformed in female patients (age range, 12–94 years; mean age,52 years ± 10 [standard deviation]) who presented between 2002and 2014 at a single clinical site. A total of 2555 breast cancers wereselected that had been segmented on two-dimensional (2D) images byradiologists, as well as 60 108 benign breasts that served asexamples of noncancerous tissue; all these were used for model training.For testing, an additional 250 breast cancers were segmentedindependently on 2D images by four radiologists. Authors selected amongseveral three-dimensional (3D) deep convolutional neural networkarchitectures, input modalities, and harmonization methods. The outcomemeasure was the Dice score for 2D segmentation, which was comparedbetween the network and radiologists by using the Wilcoxon signed ranktest and the two one-sided test procedure.ResultsThe highest-performing network on the training set was a 3D U-Net withdynamic contrast-enhanced MRI as input and with intensity normalized foreach examination. In the test set, the median Dice score of this networkwas 0.77 (interquartile range, 0.26). The performance of the network wasequivalent to that of the radiologists (two one-sided test procedureswith radiologist performance of 0.69–0.84 as equivalence bounds,P < .001 for both; n =250).ConclusionWhen trained on a sufficiently large dataset, the developed 3D U-Netperformed as well as fellowship-trained radiologists in detailed 2Dsegmentation of breast cancers at routine clinical MRI.Keywords: MRI, Breast, Segmentation, Supervised Learning,Convolutional Neural Network (CNN), Deep Learning Algorithms, MachineLearning AlgorithmsPublished under a CC BY 4.0 license.Supplemental material is available for thisarticle.

The convolutional neural network (CNN) architecture has shown remarkable success in image classification and segmentation. Its popularity has increased promptly due to various factors such as exponential growth in computational resources, availability of benchmark datasets, supporting libraries, and open-source software. The efficiency of CNN architecture majorly depends on the complexity of the architecture, availability of datasets, and hyperparameter selection. But, due to the huge number of parameters in CNN architecture, its selection has completely remained ad hoc in the past works. In this article, a novel encoding technique has been proposed that can represent complex CNN architecture effectively. The article defines basic building blocks to represent CNN architecture such as the genesis block, transit block, agile block, and output block. This encoding structure is used to generate dynamic length chromosome structure and initialized using evolutionary algorithms. A comparative analysis is also presented that shows compared its effectiveness with existing encoding representations on the basis of the number of encoding parameters, training cost, and efficiency.

Chaos Game Representation (CGR) is an emerging means of visualising and representing genomic and proteomic sequences. There exist many open questions related to its effective application to various computational tasks. In this work, we begin to address some of these questions by comparing four variants of the Chaos Game to generate CGR imagery as part of a multi-class classification task to identify the source organism for a given protein. We propose a novel nodal configuration for icosagon and 20-flake CGRs. Using two datasets, we performed fine-tuning using seven deep convolutional neural network (CNN) architectures and report modest performance over random among the 56 test conditions, highlighting certain shortcomings in effectively leveraging CGR in conjunction with deep CNN architectures. Many of the insights from this work will serve to orient subsequent protein-related studies involving CGR-based encoding and be generally applicable to disparate domains seeking to leverage CGR for sequence-type data.

This study presents a comparative analysis of the classification performance of facial and emotion recognition systems using Machine Learning (ML) and Deep Learning (DL) algorithms. The primary objective of this work is to evaluate the applicability of emotion recognition in fields such as psychotherapy and crime analysis, using the FER-2013 dataset.The study was conducted with ML algorithms such as Support Vector Machines (SVM), Random Forest (RF), K-Nearest Neighbor (KNN), Decision Trees, and Gradient Boosting, as well as the DL algorithm, Convolutional Neural Network (CNN). Supported by the application of feature selection, preprocessing, and feature extraction techniques, the model’s performance was measured using standard metrics such as accuracy, precision, F1-score, and AUC-ROC.The experimental results showed that the highest classification accuracy (46.61%) was achieved with the CNN model. While the ML models generally offered lower accuracy, they provided advantages in terms of computational efficiency in specific scenarios.This study aims to contribute to the literature by providing a comparative analysis of ML and DL algorithms and by highlighting the effect of data preprocessing on performance. The findings set targets for future work, such as real-time system integration and hybrid model development.

Background Combining the artificial intelligence algorithm with the known clinical risk factors may provide enhanced accuracy for prediction of the hidden atrial fibrillation (AF) in patients with embolic stroke with undetermined source (ESUS). Purpose We aimed to develop enhanced prediction models for AF with deep learning algorithm (DLA) and clinical predictors in patients with ESUS. The DLA was created to identify the patients with paroxysmal AF based on their electrocardiograms (ECG) during sinus rhythm. Methods We analyzed the 221 patients who underwent insertable cardiac monitor (ICM) for AF detection following ESUS. The DLA was previously developed with sinus rhythm ECGs of 10,605 paroxysmal AF patients and 50,522 non-AF patients. The convolutional neural network was used for the DLA. The primary endpoint was defined as any AF episode lasting over 5 min by ICM. The atrial ectopic burden (AEB) was calculated as the percentage of the number of conducted QRS by atrial ectopy on Holter monitoring. Results AF (≥5 min) was detected by ICM in 32 patients (14.5%) during follow-up period of 15.1±8.6 months. AF patients had higher AEB (0.199% vs 0.023%, p&amp;lt;0.001), larger left atrial diameters (LAD, 41.2 mm vs 35.7 mm, p&amp;lt;0.001), and larger left atrial volume index (LAVI, 46.4 ml/m2 vs 32.3 ml/m2, p&amp;lt;0.001) than those without AF. The means of calculated probabilities of AF by DLA were higher in patients with AF than those without AF (63.8% vs 40.2%, p&amp;lt;0.001). In the receiver operating characteristic curve analysis, the areas under the curve (AUC) were the highest in DLA (0.824) followed by AEB (0.784), LAVI (0.780), and LAD (0.768). The multivariable model with AEB, LAVI, and DLA demonstrated excellent prediction accuracy for paroxysmal AF (AUC: 0.902, Figure 1) Conclusions In patients with ESUS, the DLA outperformed other clinical risk factors for prediction of AF. Combining DLA with AEB, LAD and LAVI could is a potential useful tool to predict AF in ESUS patients. Funding Acknowledgement Type of funding sources: None.

Early and accurate identification of brain tumors is essential for determining effective treatment strategies and improving patient outcomes. Artificial intelligence (AI) and deep learning (DL) techniques have shown promise in automating diagnostic tasks based on magnetic resonance imaging (MRI). This study evaluates the performance of four pre-trained deep convolutional neural network (CNN) architectures for the automatic multi-class classification of brain tumors into four categories: Glioma, Meningioma, Pituitary, and No Tumor. The proposed approach utilizes the publicly accessible Brain Tumor MRI Msoud dataset, consisting of 7023 images, with 5712 provided for training and 1311 for testing. To assess the impact of data availability, subsets containing 25%, 50%, 75%, and 100% of the training data were used. A stratified five-fold cross-validation technique was applied. The CNN architectures evaluated include DeiT3_base_patch16_224, Xception41, Inception_v4, and Swin_Tiny_Patch4_Window7_224, all fine-tuned using transfer learning. The training pipeline incorporated advanced preprocessing and image data augmentation techniques to enhance robustness and mitigate overfitting. Among the models tested, Swin_Tiny_Patch4_Window7_224 achieved the highest classification Accuracy of 99.24% on the test set using 75% of the training data. This model demonstrated superior generalization across all tumor classes and effectively addressed class imbalance issues. Furthermore, we deployed and benchmarked the best-performing DL model on embedded AI platforms (Jetson AGX Xavier and Orin Nano), demonstrating their capability for real-time inference and highlighting their feasibility for edge-based clinical deployment. The results highlight the strong potential of pre-trained deep CNN and transformer-based architectures in medical image analysis. The proposed approach provides a scalable and energy-efficient solution for automated brain tumor diagnosis, facilitating the integration of AI into clinical workflows.

Development in Computer vision applications, most prominently in Artificial Intelligence (AI) over the past decade, has encouraged researchers to use computational algorithms. Machine Learning (ML) and Deep Learning (DL) algorithms are getting attention in the biomedical area to early diagnosis and prognosis of lethiferous diseases with higher accuracy using statistical analysis. Cervical cancer is one of the predominant gynecological infectious forms of cancer in females ecumenically, generally transpiring in less-developed nations. DL algorithms are more optimized and convenient due to the automatic feature extraction in Cervical lesion detection at an early phase. Here we analyze the convolutional neural network (CNN) models' performance using variation in channels depth comprises in the convolution layers to classify multi-class liquid-based cytology (LBC) Whole slide images (WSI). We propose three CNN models having two convolution layers with the number of channels (4,8), (8,16), and (32,64) and two pooling layers. CNN model with the highest number of channels in the convolution layers gives the leading performance with an accuracy of 96.89%, precision of 93.38%, the sensitivity of 93.75%, and F-score of 94.15%.

In today's digital world, app stores have become an essential part of software distribution, providing customers with a wide range of applications and opportunities for software developers to showcase their work. This study elaborates on the importance of end-user feedback for software evolution. However, in the literature, more emphasis has been given to high-rating & popular software apps while ignoring comparatively low-rating apps. Therefore, the proposed approach focuses on end-user reviews collected from 64 low-rated apps representing 14 categories in the Amazon App Store. We critically analyze feedback from low-rating apps and developed a grounded theory to identify various concepts important for software evolution and improving its quality including user interface (UI) and user experience (UX), functionality and features, compatibility and device-specific, performance and stability, customer support and responsiveness and security and privacy issues. Then, using a grounded theory and content analysis approach, a novel research dataset is curated to evaluate the performance of baseline machine learning (ML), and state-of-the-art deep learning (DL) algorithms in automatically classifying end-user feedback into frequently occurring issues. Various natural language processing and feature engineering techniques are utilized for improving and optimizing the performance of ML and DL classifiers. Also, an experimental study comparing various ML and DL algorithms, including multinomial naive Bayes (MNB), logistic regression (LR), random forest (RF), multi-layer perception (MLP), k-nearest neighbors (KNN), AdaBoost, Voting, convolutional neural network (CNN), long short-term memory (LSTM), bidirectional long short term memory (BiLSTM), gated recurrent unit (GRU), bidirectional gated recurrent unit (BiGRU), and recurrent neural network (RNN) classifiers, achieved satisfactory results in classifying end-user feedback to commonly occurring issues. Whereas, MLP, RF, BiGRU, GRU, CNN, LSTM, and Classifiers achieved average accuracies of 94%, 94%, 92%, 91%, 90%, 89%, and 89%, respectively. We employed the SHAP approach to identify the critical features associated with each issue type to enhance the explainability of the classifiers. This research sheds light on areas needing improvement in low-rated apps and opens up new avenues for developers to improve software quality based on user feedback.

Deep leaning in food safety and authenticity detection: An integrative review and future prospects

The application of deep learning (DL) algorithms to non-destructive evaluation (NDE) is now becoming one of the most attractive topics in this field. As a contribution to such research, this study aims to investigate the application of DL algorithms for detecting and estimating the looseness in bolted joints using a laser ultrasonic technique. This research was conducted based on a hypothesis regarding the relationship between the true contact area of the bolt head-plate and the guided wave energy lost while the ultrasonic waves pass through it. First, a Q-switched Nd:YAG pulsed laser and an acoustic emission sensor were used as exciting and sensing ultrasonic signals, respectively. Then, a 3D full-field ultrasonic data set was created using an ultrasonic wave propagation imaging (UWPI) process, after which several signal processing techniques were applied to generate the processed data. By using a deep convolutional neural network (DCNN) with a VGG-like architecture based regression model, the estimated error was calculated to compare the performance of a DCNN on different processed data set. The proposed approach was also compared with a K-nearest neighbor, support vector regression, and deep artificial neural network for regression to demonstrate its robustness. Consequently, it was found that the proposed approach shows potential for the incorporation of laser-generated ultrasound and DL algorithms. In addition, the signal processing technique has been shown to have an important impact on the DL performance for automatic looseness estimation.

Invisible lost time (ILT) has been estimated to contribute significantly to well construction costs. Reduction of drilling connection time can lead to significant savings, especially in offshore drilling projects. The overall time of a drilling connection can easily be measured using conventional sensors on the rig. However, to gain further insight into the source of operational inefficiencies it is beneficial to breakdown the overall drilling connection process into smaller sub-processes and quantify the time spent doing each. Current sensor technology does not allow us to easily measure these sub-processes on the rig. In this paper, we outline a deep learning-based computer vision method to analyze and measure such sub-processes within the overall drilling connection process using a real-time video feed. Video of the drilling connections is streamed in real-time using a novel IT framework. In a proof of concept exercise, we applied image recognition techniques to enable us to breakdown and classify the sub-processes during the drilling connections. Convolutional neural networks (CNNs) - a deep learning algorithm - are used to analyze these video images frame by frame to identify rig activities. The workflow includes an analytics pipeline to capture video on the rig, transfer of data to the office, video recognition analysis, tabulation of results, and delivery of this result to a graphical interface for cognitive analytics. We performed experiments wherein CNNs were used on the video images to diagnose rig activities with good accuracy. Incorporating the temporal information using a recurrent network has been shown to further improve analysis accuracy. The described workflow is a suggested method for automating the detection of inefficiencies on drilling rigs using rig floor video and machine learning. For the demonstration case, we successfully analyzed video captured on an offshore rig and derived high value useful information using machine learning. This video analysis information can be further combined with conventional drilling sensor data to boost accuracy to identify and confirm rig activities and to quantify invisible lost time during each connection. The presented techniques demonstrate the potential of video analytics as a reliable, low-cost means to effectively "micro-analyze" various rig operations with the aim to identify and replicate best composite performance.