Respiratory Sound Abnormality Classification using Multipath Deep Learning Method

Excessive withdrawal of groundwater for agricultural irrigation can cause seawater intrusion into coastal aquifers. Such a case will in turn results in deterioration of irrigation water quality. Determination of irrigation water quality with traditional methods is a time-consuming and costly process. However, machine learning algorithms can be useful tools for modeling and estimating groundwater quality used for irrigation water purposes. In this study, TDS, PS, SAR, and Cl parameters of groundwater were estimated with models based on EC and pH variables. For this purpose, prediction performances of two different deep learning methods (convolutional neural network (CNN) and deep neural network (DNN)) and two different classical machine learning (Random Forest (RF) and extreme gradient boosting (XGBoost)) methods were compared. In addition, predictive uncertainty of the models was determined by quantile regression (QR) analysis. Performance criteria and results of uncertainty analysis revealed that CNN (in testing phase, NSE = 0.95 for TDS, NSE = 0.96 for PS, NSE = 0.67 for SAR and NSE = 0.93 for CI) and DNN (in testing phase, NSE = 0.91 for TDS, NSE = 0.91 for PS, NSE = 0.57 for SAR and NSE = 0.94 for Cl) models had quite a close performance in estimation of TDS, PS, SAR, and Cl parameters and higher than the other two classical machine learning methods. As a result, the CNN model can be considered the best performing model in estimating all quality parameters due to the highest NSE and lowest RMSE values. In addition, the Taylor diagram showed that the values estimated using the CNN model had the highest correlation with the measured data. It was determined that the model with the lowest uncertainty based on the PICP statistics was DNN, followed by the CNN model. However, the CNN model has predicted outliers more accurately. Present findings proved that deep learning models could offer efficient tools for predicting irrigation water quality parameters.

Deep learning models for short-term travel speed prediction on urban expressways, such as the convolutional neural network (CNN), still present several limitations in multiscale spatiotemporal feature extraction. Hence, in this paper, three hybrid CNN models are proposed to improve the basic CNN model with regard to three target aspects for short-term (i.e., 5 min) travel speed prediction on urban expressways. More specifically, long short-term memory (LSTM), AutoEncoder (AE), and Inception module are incorporated into the basic CNN model to capture multiscale spatiotemporal features of travel speed data effectively and improve the accuracy and robustness of the basic CNN model. Based on loop detector data collected on the Yan’an expressway in Shanghai, the proposed hybrid CNN models are trained and tuned. To validate the improvements on the target aspects, a comprehensive comparison is conducted using a classical statistical model (i.e., autoregressive integrated moving average), a typical shallow neural network model (i.e., artificial neural network), and two basic deep learning models (i.e., recurrent neural network and CNN). Results show that the prediction accuracies of all the proposed hybrid CNN models exceed 96% and the mean absolute errors are less than 2.5 km/h, which are superior to other models. In terms of target improving aspects, two new metrics were introduced, and the proposed models, especially the AE–CNN model, showed better robustness under various input data structures and traffic states. The LSTM–CNN model outperformed the other models in learning time-series features, and the Inception–CNN model is superior in reproducing the dynamics of traffic congestion patterns on urban expressways.

BackgroundIt is difficult for orthodontists to accurately predict the growth trend of the mandible in children with anterior crossbite. This study aims to develop a deep learning model to automatically predict the mandibular growth result into normal or overdeveloped using cephalometric radiographs.MethodsA deep convolutional neural network (CNN) model was constructed based on the algorithm ResNet50 and trained on the basis of 256 cephalometric radiographs. The prediction behavior of the model was tested on 40 cephalograms and visualized by equipped with Grad-CAM. The prediction performance of the CNN model was compared with that of three junior orthodontists.ResultsThe deep-learning model showed a good prediction accuracy about 85%, much higher when compared with the 54.2% of the junior orthodontists. The sensitivity and specificity of the model was 0.95 and 0.75 respectively, higher than that of the junior orthodontists (0.62 and 0.47 respectively). The area under the curve value of the deep-learning model was 0.9775. Visual inspection showed that the model mainly focused on the characteristics of special regions including chin, lower edge of the mandible, incisor teeth, airway and condyle to conduct the prediction.ConclusionsThe deep-learning CNN model could predict the growth trend of the mandible in anterior crossbite children with relatively high accuracy using cephalometric images. The deep learning model made the prediction decision mainly by identifying the characteristics of the regions of chin, lower edge of the mandible, incisor teeth area, airway and condyle in cephalometric images.

Understanding the learning mechanism of convolutional neural networks in spectral analysis

This study leveraged Convolutional Neural Network (CNN) models to estimate canopy height in Southeast Australian forests before and after the 2019–2020 bushfire event, using inputs from Sentinel-1, Sentinel-2, spectral indices, and terrain features and GEDI canopy height (rh99) as target variables. Our research consisted of three primary objectives: (1) an evaluation of GEDI rh99 canopy height in relation to an nDSM derived from airborne LiDAR, (2) the development of two CNN models for pre- and post-fire scenarios, and (3) utilizing the trained CNN models to generate pre- and post-fire canopy height maps and canopy height change maps across the continuous landscape. GEDI rh99 accuracy analysis revealed R 2 = 0.85, RMSE = 7.25 m and nRMSE = 0.23 for pre-fire GEDI and R 2 = 0.78, RMSE = 10.1 m and nRMSE = 0.3 for post-fire GEDI. The pre-fire CNN model achieved R 2 = 0.75, RMSE = 7.29 m and nRMSE = 0.22, and post-fire CNN model achieved R 2 = 0.62, RMSE = 11.67 m, and nRMSE = 0.34 when validated against nDSM. Bias analysis was conducted, revealing that GEDI rh99 underestimated nDSM across all canopy height ranges, and slope has no significant impact on GEDI accuracy. Notably, post-fire GEDI rh99 exhibited significant underestimation in high to extreme fire severity. The CNN models’ prediction displayed overestimation in short forests < 20 m and increasing underestimation in taller forests > 20 m and underestimation in high and extreme fire severity. Subsequent investigation indicated that canopy layer thinning in high fire severity conditions resulted in weak GEDI waveform signals and consequent bias. Additionally, the GEDI rh99 bias was propagated to the CNN models, together with insensitivity of spectral band values to canopy height in dense and burnt forests potentially contributed to models’ bias. Finally, we demonstrated CNN models’ ability to monitor forest recovery by generating canopy height maps spanning East Gippsland from 2019 to 2023.

Bone cancer is a significant health issue that leads to severe complications and deaths worldwide. Early detection can significantly improve patient outcomes, often resulting in a complete cure. Traditional approaches to managing bone cancer can be augmented with technology-driven methods, particularly those enabled by artificial intelligence. Convolutional Neural Networks (CNNs) and their variants have proven effective in medical data analysis. However, deep learning techniques require enhancements to improve performance in cancer detection across various medical imaging modalities. In this paper, we propose a deep-learning framework that utilizes advanced CNN models for the automatic screening of bone cancer. We have enhanced both the CNN model and the ResNet-50 model, which are integral components of the proposed framework. Additionally, we introduced an algorithm called Learning-based Bone Cancer Detection (LbBCD), designed to optimize the utilization of these enhanced deep learning models to improve bone cancer detection efficiency. Our research emphasizes a Region of Interest (ROI) based approach to enhance the screening process for bone cancer. Using a benchmark dataset known as the Bone CT Scan dataset, our empirical study demonstrated that the proposed deep learning framework, integrated with enhanced CNN and ResNet-50 models, achieved remarkable performance. Specifically, the enhanced CNN model reached an accuracy of 90.90%, while the enhanced ResNet-50 model achieved an accuracy of 92.20%, outperforming state-of-the-art deep learning models. Therefore, this proposed system can be integrated into healthcare applications for automatically screening bone cancer, contributing to a clinical decision support system for healthcare professionals.

Automatic prediction of citrus fruit diseases requires the selection of a suitable classification model among various Convolutional Neural Network (CNN) models. The CNN models are the most effective for image classification. However, more than one CNN model occasionally performs closer to each other. Choosing the best classification model requires considerable effort in this situation. In this study, 17 CNN models were used for citrus fruit disease identification. Citrus fruit diseases include anthracnose, blackspot, canker, scab, and healthy. In this research, the performance of CNN models was analysed, and a two-phase statistical analysis was carried out to determine which CNN model provided the most accurate predictions of citrus crop disease. The 17 CNN models used were AlexNet, Darknet, Densenet, efficientnet, nasnetlarge, googlenet, inceptionresnetv2, inceptionv3, mobilenetv2, nasnetmobile, Xception, squeezenet, resnet18, resnet50, resnet101, vgg16, and vgg19. The two-phase statistical analysis was Duncan's multiple range test, followed by the Wilcoxon signed-rank test is the second one. Again, in order to do a statistical analysis, nine different indicators, including “accuracy, sensitivity, specificity, precision, FPR, F1 Score, MCC, Kappa, and computing time”, were taken into consideration. After the execution of 17 CNN models and twophase statistical analysis, it was revealed that resnet101 is superior among CNN models for citrus fruit disease prediction.

To better understand and improve the prediction of the seasonal surface temperature (TS) across the United States, we employed convolutional neural network (CNN) models trained on the Community Earth System Model Version 2 Large Ensemble (CESM2 LENS). We used lagged sea surface temperatures (SST) over the tropical Pacific region, containing the information of the El Niño Southern Oscillation (ENSO), as input for the CNN models. ENSO is the principal driver of variability in seasonal US surface temperatures (TSUS) and employing CNN models allows for spatiotemporal aspects of ENSO to be analyzed to make seasonal TSUS predictions. For predicting TSUS, the CNN models exhibited significantly improved skill over standard statistical multilinear regression (MLR) models and dynamical forecasts across most regions in the US, for lead times ranging from 1 to 6 months. Furthermore, we employed the CNN models to predict seasonal TSUS during extreme ENSO events. For these events, the CNN models outperformed the MLR models in predicting the effects on seasonal TSUS, suggesting that the CNN models are able to capture the ENSO‐TSUS teleconnection more effectively. Results from a heatmap analysis demonstrate that the CNN models utilize spatial features of ENSO rather than solely the magnitude of the ENSO events, indicating that the improved skill of seasonal TSUS is due to analyzing spatial variation in ENSO events. The proposed CNN model demonstrates a promising improvement in prediction skill compared to existing methods, suggesting a potential path forward for enhancing TSUS forecast skill from subseasonal to seasonal timescales.

People counting and pedestrian flow statistics are challenging tasks because of the perspective distortions, appearance changes and occlusion. In this paper, we address the two tasks: people counting in images of highly dense crowds and pedestrian flow statistics in a place over a period of time. Our first contribution is to propose a new convolution neural network (CNN) model which is composed of a deep and shallow fully convolution network to fulfill the task of people counting. We extract different layer features from the deep fully convolution network and the last layer features from the shallow fully convolution network, and concatenate them together. After that we add two deconvolution layers to make the output image have the same resolution with the input image. Our second contribution is to combine pedestrian flow statistics task with people counting task. According to the density maps that CNN model generates, we can calculate the number of people crossing a place based on the recurrent neural network (RNN). Besides, we also have collected two datasets and labelled them. Extensive experiments have been implemented, our people counting method outperforms other existing methods, and our pedestrian flow statistics method combined with CNN model also outperforms the model which only uses long-short term memory (LSTM).

Due to the continuous growth and advancement of technology, an enormous volume of text data is generated daily across various sources including social media platforms, websites, search engines, healthcare records, and news articles. Extracting meaningful patterns from text data, such as viewpoints, related theories, journal distribution, facts, and the development of online news text, is a challenging task due to the varying lengths of the texts. One issue arises from the length of the text data itself, and another challenge lies in extracting valuable features, especially in news articles. In the deep learning models, the convolutional neural networks (CNNs) are capable of capturing local features in text data, but unable to capture the structural information or semantic relationships between words. Consequently, a sole CNN network often yields poor performance in text classification tasks, whereas the Gated Recurrent Unit (GRU) is adept at effectively extracting semantic information and understanding the global structural relationships present in textual data. This paper presents a solution to the problem by introducing a new text classification that integrates the strengths of CNN and GRU. The proposed hybrid models incorporate word vectorization and word dispersion in parallel. Initially, the model trains word vectors using the Word2vec model and then leverages the GRU model to capture semantic information from text sentences. Subsequently, the CNN method is employed to capture crucial semantic features, leading to classification using the SoftMax layer. Experimental findings demonstrated that the proposed hybrid GRU_CNN model outperformed and achieved accuracy 97.73% as compared to individual CNN, LSTM, and GRU models in terms of classification effectiveness and accuracy.

Distinguishing pericarpium citri reticulatae of different origins using terahertz time-domain spectroscopy combined with convolutional neural networks

Date palm ( Phoenix dactylifera L.) is one of the most valuable domesticated fruit trees characterized with thousands of varieties that grow in different arid regions. Because of high diversification, discrimination between date varieties at different post-harvest handling and production stages is necessary. In this study, five different CNN (Convolutional Neural Network) models, namely ResNet18, ResNet50, MobileNet, GoogleNet and DenseNet, are used as fine-tuning tools for the classification of five Moroccan date fruit varieties: ‘Mejhoul’, ‘Boufeggous’, ‘Assiane’, ‘Aziza’ and ‘Bousthammi’. The features of MobileNet, the most successful of these CNN models, were analyzed with an RNN (Recurrent Neural Network)-based LSTM (Long short-term memory) architecture. In addition, feature selection is performed for MobileNet features to achieve a more successful classification with fewer features. As a result of LSTM-based classification of both original MobileNet features and selected features, higher classification accuracy was achieved in comparison with other CNN models. Moreover, LSTM with selected features provided the most successful discrimination ability. The accuracies obtained as a result of the classification of original MobileNet features and selected features with LSTM were 99.63% and 99.70% respectively. Overall, the results indicated that the LSTM-based architecture with fewer features improves the success of existing CNN models for date fruits.

The main goal of this research was to accurately diagnose diseases in pepper plants using convolutional neural network (CNN) models and visual parameters features. Thus, we aimed to build a computing system that can utilise visual cues to identify plant diseases with almost 100% reliability. A total of 2,200 images were trained and tested on a dataset, which was divided into healthy leaves and those with bacterial ailments. The images were preprocessed, resized to 300x300 pixels, and then segmented to extract the relevant traits from them. This CNN model, in a word, is accurate because it detects diseases with 99.65% accuracy. If we want to speak of a high accuracy rate, that's the CNN model. It learns to identify the intricate patterns and features in pepper plants that are associated with diseases. CNN can make revolutionary changes to the identification of plant diseases and help prevent crop damage through timely treatments. Automatic identification of the disease makes life easier for both agriculturists and scientists. The results underscore the importance of image preprocessing, segmentation, and feature extraction in improving the ability of CNN models to locate diseases. Additionally, the performance of the CNN model was compared with other machine learning models such as KNN, Decision Tree, ANN, and Random Forest. It was found that the developed CNN model can predict the response with greater accuracy than the others. Modern high-tech precision farming systems might utilise proposed CNN models for plant disease diagnosis.

PurposeTo develop and compare deep learning (DL) algorithms to detect keratoconus on the basis of corneal topography and validate with visualization methods.MethodsWe retrospectively collected corneal topographies of the study group with clinically manifested keratoconus and the control group with regular astigmatism. All images were divided into training and test datasets. We adopted three convolutional neural network (CNN) models for learning. The test dataset was applied to analyze the performance of the three models. In addition, for better discrimination and understanding, we displayed the pixel-wise discriminative features and class-discriminative heat map of diopter images for visualization.ResultsOverall, 170 keratoconus, 28 subclinical keratoconus and 156 normal topographic pictures were collected. The convergence of accuracy and loss for the training and test datasets after training revealed no overfitting in all three CNN models. The sensitivity and specificity of all CNN models were over 0.90, and the area under the receiver operating characteristic curve reached 0.995 in the ResNet152 model. The pixel-wise discriminative features and the heat map of the prediction layer in the VGG16 model both revealed it focused on the largest gradient difference of topographic maps, which was corresponding to the diagnostic clues of ophthalmologists. The subclinical keratoconus was positively predicted with our model and also correlated with topographic indexes.ConclusionsThe DL models had fair accuracy for keratoconus screening based on corneal topographic images. The visualization mentioned in the current study revealed that the model focused on the appropriate region for diagnosis and rendered clinical explainability of deep learning more acceptable.Translational RelevanceThese high accuracy CNN models can aid ophthalmologists in keratoconus screening with color-coded corneal topography maps.

PurposeSemantic segmentation is a fundamental part of the surgical application of deep learning. Traditionally, segmentation in vision tasks has been performed using convolutional neural networks (CNNs), but the transformer architecture has recently been introduced and widely investigated. We aimed to investigate the performance of deep learning models in segmentation in robot-assisted radical prostatectomy (RARP) and identify which of the architectures is superior for segmentation in robotic surgery.Materials and MethodsIntraoperative images during RARP were obtained. The dataset was randomly split into training and validation data. Segmentation of the surgical instruments, bladder, prostate, vas and seminal vesicle was performed using three CNN models (DeepLabv3, MANet, and U-Net++) and three transformers (SegFormer, BEiT, and DPT), and their performances were analyzed.ResultsThe overall segmentation performance during RARP varied across different model architectures. For the CNN models, DeepLabV3 achieved a mean Dice score of 0.938, MANet scored 0.944, and U-Net++ reached 0.930. For the transformer architectures, SegFormer attained a mean Dice score of 0.919, BEiT scored 0.916, and DPT achieved 0.940. The performance of CNN models was superior to that of transformer models in segmenting the prostate, vas, and seminal vesicle.ConclusionsDeep learning models provided accurate segmentation of the surgical instruments and anatomical structures observed during RARP. Both CNN and transformer models showed reliable predictions in the segmentation task; however, CNN models may be more suitable than transformer models for organ segmentation and may be more applicable in unusual cases. Further research with large datasets is needed.