Pneumothorax Detection System in Thoracic Radiography Images Using CNN Method

The Part 1 prequel to this review evaluated the evolution of modelling techniques used in evaluation of fruit quality over the past three decades and noted a progression towards the use of artificial neural networks (ANNs) and convolutional neural networks (CNNs). In this review, Part 2, the use of CNNs for NIR fruit quality evaluation is explored, given the success of CNNs in various other fields, such as image, video, speech, and audio processing, and the availability of large (open source) datasets of fruit spectra and reference quality attribute, which is required for the training of CNN models. The review provides an overview of deep learning and the CNN architectures and techniques used in NIR spectroscopy for regression modelling, with advantages and disadvantages identified. Studies using CNN for NIR based fruit quality evaluation are then critically examined. Eight publications have presented on models using the same open-source mango dry matter calibration and test set, enabling inter-method comparisons. CNN models have been demonstrated to be accurate, precise and robust. Techniques of transfer learning for CNN models offer an alternative solution to model updating and calibration transfer methods applied in traditional chemometrics. The review has highlighted crucial areas that require resolution and exploration in this application through future research, including, (i) data requirements for training a CNN (ii) optimal spectral pre-processing for CNN (iii) CNN architecture and hyper-parameter selection and tuning for fruit quality evaluation (iv) CNN model interpretability and explainability. Future studies must conduct clearer comparison to partial least squares (PLS) regression and shallow ANNs to better assess the prospective benefit of using CNN, a more complex model. The potential for visualisation of spectra relevance to the CNN model using techniques such as GradCam, currently employed in visualising 2D-CNN models, remains to be explored.

This research aims to implement deep learning techniques to determine fact and fake news in Indonesian language. The methods used are Convolutional Neural Network (CNN) and Long Short Term Memory (LSTM). The stages of the research consisted of collecting data, labeling data, preprocessing data, word embedding, splitting data, forming CNN and LSTM models, evaluating, testing new input data and comparing evaluations of the established CNN and LSTM models. The Data are collected from a fact and fake news provider site that is valid, namely TurnbackHoax.id. There are 1786 news used in this study, with 802 fact and 984 fake news. The results indicate that the CNN and LSTM methods were successfully applied to determine fact and fake news in Indonesian language properly. CNN has an accuracy test, precision and recall value of 0.88, while the LSTM model has an accuracy test and precision value of 0.84 and a recall of 0.83. In testing the new data input, all of the predictions obtained by CNN are correct, while the prediction results obtained by LSTM have 1 wrong prediction. Based on the evaluation results and the results of testing the new data input, the model produced by the CNN method is better than the model produced by the LSTM method.

In this paper, the Convolutional Neural Network (CNN) architecture, which is one of the deep learning architectures, is used to classify the basic circuit components drawn by hand. During the training and testing stages of the model, a new dataset containing images of 863 circuit components manually drawn by different people is created. The data set contains images of four different classes of circuit components such as resistor, inductor, capacitor and voltage source. All images have been fixed to the same size and converted to grayscale to increase recognition performance and reduce process complexity. In the study, training for four classes is performed with CNN architecture. Based on the CNN architecture, four new CNN models are employed with different the number of layers. The training and validation results of these models are compared separately, the model with the highest training and validation performance is observed with four layer CNN model (CNN-4). This model obtained 84.41% accuracy rate at classification task.

Empirical-statistical Downscaling (SD) techniques are valuable tools able to generate high-resolution climate information needed to carry out impact studies. In this regard, Convolutional Neural Networks (CNNs) are promising SD techniques capable of handling large amounts of data and extracting relevant predictor information for each particular site. These characteristics of the CNN represent a major advantage over traditional SD methods, which typically rely on human-guided predictor selection. Notwithstanding, an adequate tuning of the CNN is key for optimising their potential.In southern South America (SSA), CNNs has proven to be skilful in representing daily extreme temperatures and extrapolating into future scenarios. Although the selection of the activation function introduces a source of uncertainty in the future projections. In this context, this study aims to explore the use of CNNs as a statistical downscaling tool to simulate the wet bulb temperature (Tw) over SSA, a multivariate heat-stress index estimated from temperature and humidity. Tw has been widely used as a heat-stress proxy in different parts of the world, however, its characterisation and modelling in SSA remain as a pending task. To this end, four different CNN architectures regarding the activation function (ReLU or linear), domain size and configuration of the CNN layers were tested. All CNN models were trained during summer days using a cross-validation (CV) scheme in the period 1991-2020 and then evaluated in four unseen summers between 2021 and 2024. For comparison purposes, CNN models were similarly trained and validated to simulate maximum temperature (Tx). Overall, CNN models well represented all the features evaluated, including the heat-waves that took place in the summers evaluated independently. In particular, CNN models presents a better performance in simulating Tw than Tx with smaller errors in terms of mean and extremes aspects. Regarding the domain size, for both temperatures, the configuration with the smaller domain yields the best results. Also in this latter case, the reduction of the number of filter size in the last layer slightly improves the representation of Tx. When considering the large domain, the differences between the CNNs based on different activation functions increase, and CNN models with linear configuration outperform the ones with ReLu. The findings of this work reinforces the potential of CNNs for climate downscaling in SSA, especially for its use to simulate multivariate impact indices.

Due to the continuous growth and advancement of technology, an enormous volume of text data is generated daily across various sources including social media platforms, websites, search engines, healthcare records, and news articles. Extracting meaningful patterns from text data, such as viewpoints, related theories, journal distribution, facts, and the development of online news text, is a challenging task due to the varying lengths of the texts. One issue arises from the length of the text data itself, and another challenge lies in extracting valuable features, especially in news articles. In the deep learning models, the convolutional neural networks (CNNs) are capable of capturing local features in text data, but unable to capture the structural information or semantic relationships between words. Consequently, a sole CNN network often yields poor performance in text classification tasks, whereas the Gated Recurrent Unit (GRU) is adept at effectively extracting semantic information and understanding the global structural relationships present in textual data. This paper presents a solution to the problem by introducing a new text classification that integrates the strengths of CNN and GRU. The proposed hybrid models incorporate word vectorization and word dispersion in parallel. Initially, the model trains word vectors using the Word2vec model and then leverages the GRU model to capture semantic information from text sentences. Subsequently, the CNN method is employed to capture crucial semantic features, leading to classification using the SoftMax layer. Experimental findings demonstrated that the proposed hybrid GRU_CNN model outperformed and achieved accuracy 97.73% as compared to individual CNN, LSTM, and GRU models in terms of classification effectiveness and accuracy.

Convolutional Neural Network (CNN) is a deep learning algorithm that is widely used to identify and classify a digital image object. In this study the Convolutional Neural Network (CNN) is used as an algorithm that functions to identify leaf types (certain plants) based on images obtained from a public dataset provider named Daun Jamu Indonesia. The existence of image characteristics causes the assistance process to require a more detailed feature selection process. Therefore the CNN method is used in order to solve the problem. The Convolutional Neural Network (CNN) method is capable of performing image recognition by minimizing feature extraction. CNN is also reliable in processing unstructured data because it uses a multi-layered structure of artificial reasoning networks. The image recognition process is carried out by looking for the shape of the model that matches the processed data in order to get the best results. In this study, the augmentation process was carried out on the training data and validation data so that overfitting does not occur in the Convolutional Neural Network (CNN). The results obtained in this study indicate that the Convolutional Neural Network (CNN) method can identify leaf types with a measured accuracy rate of 92% using the Confusion Matrix evaluation method. It is hoped that this research can be used as a reference for the use of the Convolutional Neural Network (CNN) method for image data, especially plant leaf types.

Some researchers propose using the Convolutional Neural Network (CNN) method to classified batik images. It can extract features automatically without the need to define feature manually from the image. However, CNN’s weakness is that its accuracy is quite low, especially for small-sized datasets, compared to machine learning methods that use handcrafted feature extraction. In this research, an ensemble CNN method is proposed to improve the accuracy of the CNN method in classifying batik images. This method will train several CNN models at once, and then by voting and averaging techniques, the output label will be determined. Test results for two different datasets show this method can improve the accuracy of the CNN method and get an accuracy value of 100%. This method is also proven to extract features faster than the state-of-the-art method like MTCD+SVM, which is included in the hand-crafted feature extraction category.

Brain Computer Interface (BCI) is a system that connects the human brain with the outside world for people who have motor skills disability problems. One form of utilization is the P300 speller which is used for character recognition or detection by classifying the P300 signal. The Convolutional Neural Network (CNN) method is a deep learning method that can be used to handle signal problems with ID-CNN. At the initial stage the data signal will be transformed and followed by a duplication process using RandomOverSampling because the amount of data in each class is not balanced. The data will be divided into training, validation, and test data. After that, a training with CNN will be conducted and followed by an evaluation to find the best model. The test results from this study are a good-fitting CNN model with an evaluation value consisting of an accuracy of 94.27%, precision of 90.64%, sensitivity / recall of 98.30%, and f-measure of 94.31%. Based on the test, the CNN method can be used and implemented in authentication detection based on the P300 signal.

Handwritten digit recognition, a task in computer vision, is critical for applications such as postal automation, banking, and digitization of forms. Traditional approaches have leveraged statistical models, but the rise of deep learning, particularly Convolutional Neural Networks (CNN) and Long-Short Term Memory (LSTM), has revolutionized the field. However, a comprehensive performance comparison of CNN and LSTM architectures in the context of handwritten digit classification remains underexplored. This study aimed to address this gap by evaluating and comparing CNN and LSTM models for the classification of handwritten digits. Two machine learning models – Convolutional Neural Network (CNN) and Long-Short Term Memory (LSTM) were trained with the preprocessed handwritten digit dataset. The CNN model was designed with multiple convolutional and pooling layers, along with dropout for regularization. The LSTM model was designed with LSTM layers to capture sequential patterns in the data, followed by a dense layer for classification. The models were implemented in python, evaluated and compared based on accuracy, precision, recall and F1-score. The evaluation and comparison results indicate that CNN achieved 99.31% accuracy, 99.0% precision, 99.0% recall, and a 99.0% F1-score, while LSTM achieved 98.90% accuracy, 99.0% precision, 99.0% recall, and a 99.0% F1-score. The results demonstrated that CNN outperformed LSTM in terms of accuracy and misclassification errors, making it the optimal choice for image-based handwritten digit recognition. This finding underscores the efficiency of CNN in addressing challenges related to digit recognition, contributing to the advancement of automated digit classification systems and improving the accuracy of image-based classification tasks.

Bangla handwritten character recognition is a popular research topic as its difficulty is higher than the recognition of other languages because of multiple formats of compound characters. State of the art Convolutional neural network (CNN) architectures are very much useful in computer vision applications. Some works have been carried out in Bangla handwritten character recognition but most of them either not very efficient or they can not classify a lot of characters. In this work, state of art pre-trained CNN architectures is used to classify 231 different Bangla handwritten characters using CMATERdb dataset. The images were first converted to B&W form with white as the foreground color. The size of the images is reduced to 28 × 28 form. These images are used as input to the CNN architectures. The weights of the state-of-the-art CNN models are kept as it was. The training learning rate was set to 0.001 and categorical cross-entropy as the error function. After 50 epochs, InceptionResNetV2 achieved the best accuracy (96.99%). DenseNet121 and InceptionNetV3 also provided remarkable recognition accuracy (96.55 and 96.20%, respectively). We also considered combination of trained InceptionResNetV2, InceptionNetV3 and DenseNet121 architectures which provided better recognition accuracy (97.69%) than other single CNN architectures but it is not feasible for using as it requires a lot of computation power and memory. The models were tested in the cases where characters look confusing to humans, but all the architectures showed equal capability in recognizing these images. Considering computational complexity, memory and capability of recognizing confused characters, InceptionResNetV2 can be said as the best performing model.

With the development of deep learning technology, an enormous number of convolutional neural network (CNN) models have been proposed to address the challenging building extraction task from very high-resolution (VHR) remote sensing images. However, searching for better CNN architectures is time-consuming, and the robustness of a new CNN model cannot be guaranteed. In this paper, an improved boundary-aware perceptual (BP) loss is proposed to enhance the building extraction ability of CNN models. The proposed BP loss consists of a loss network and transfer loss functions. The usage of the boundary-aware perceptual loss has two stages. In the training stage, the loss network learns the structural information from circularly transferring between the building mask and the corresponding building boundary. In the refining stage, the learned structural information is embedded into the building extraction models via the transfer loss functions without additional parameters or postprocessing. We verify the effectiveness and efficiency of the proposed BP loss both on the challenging WHU aerial dataset and the INRIA dataset. Substantial performance improvements are observed within two representative CNN architectures: PSPNet and UNet, which are widely used on pixel-wise labelling tasks. With BP loss, UNet with ResNet101 achieves 90.78% and 76.62% on IoU (intersection over union) scores on the WHU aerial dataset and the INRIA dataset, respectively, which are 1.47% and 1.04% higher than those simply trained with the cross-entropy loss function. Additionally, similar improvements (0.64% on the WHU aerial dataset and 1.69% on the INRIA dataset) are also observed on PSPNet, which strongly supports the robustness of the proposed BP loss.

BackgroundThe images of different flower species had small inter-class variations across different classes as well as large intra-class variations within a class. Flower classification techniques are mainly based on the features of color, shape and texture, however, the procedure always involves too many heuristics as well as manual labor to tweak parameters, which often leads to datasets with poor qualitative and quantitative measures. The current study proposed a deep architecture of convolutional neural network (CNN) for the purposes of improving the accuracy of identifying the white flowers of Fragaria × ananassa from other three wild flower species of Androsace umbellata (Lour.) Merr., Bidens pilosa L. and Trifolium repens L. in fields.ResultsThe explored CNN architecture consisted of eightfolds of learnable weights including 5 convolutional layers and 3 fully connected layers, which received a true color 227 × 227 pixels flower image as its input. The developed CNN detector was able to classify the instances of flowers at overall average accuracies of 99.2 and 95.0% in the training and test procedure, respectively. The state-of-the-art CNN model was compared with the classical models of the scale-invariant feature transform (SIFT) features and the pyramid histogram of orientated gradient (PHOG) features combined with the multi-class support vector machine (SVM) algorithm. The proposed model turned out to be much more accurate than the traditional models of SIFT + SVM at overall average accuracies of 82.9 and 55.6% in the training and test procedure and PHOG + SVM at overall average accuracies of 78.3 and 63.1%, respectively.ConclusionsThe proposed state-of-the-art CNN method demonstrates that artificial intelligence is capable of precise classification of the white flower images, whose accuracy is comparable to traditional algorithms. The presented algorithm can be further used for the discrimination of white wild flowers in fields.

Convolutional Neural Networks (CNNs) have demonstrated impressive performance in complex machine learning tasks such as classification and regression problems. A reliable neural network structure plays a decisive role in CNN studies. Through comparing and analyzing the structure of neural networks, a model structure for better visualization performance has been discovered, and such a method supports the development of deep learning research. These studies are of particular importance in end-to-end systems for autonomous driving to imitate human driving, where the interpretability of the system is limited. Because of the uncertainty of the ground truth, for the determination of human steering in an image, it is difficult to accurately compare the visualization performance of different CNN models or different visualization methods. For practical applications, however, an objective and quantitative measure for assessing visualization performance is necessary. Therefore, a method to evaluate the visualization performance of CNN models using a driver model instead of human drivers is proposed, to generate a data set which can be used to determine the decisional point (ground truth) in the input image. Then, an exclusive method is also put forth, to quantitatively calculate the relationship between the decisional point (ground truth) and the visualization results produced by CNN models. In this paper, five CNN models as an autonomous steering controller are designed based on PilotNet, and the visualization abilities of each CNN models is compared by three evaluation indicators. By comparing the visualization performance of five different CNN models, it is shown that the proposed method can successfully assess the visualization level of the CNN model.

Automatic prediction of citrus fruit diseases requires the selection of a suitable classification model among various Convolutional Neural Network (CNN) models. The CNN models are the most effective for image classification. However, more than one CNN model occasionally performs closer to each other. Choosing the best classification model requires considerable effort in this situation. In this study, 17 CNN models were used for citrus fruit disease identification. Citrus fruit diseases include anthracnose, blackspot, canker, scab, and healthy. In this research, the performance of CNN models was analysed, and a two-phase statistical analysis was carried out to determine which CNN model provided the most accurate predictions of citrus crop disease. The 17 CNN models used were AlexNet, Darknet, Densenet, efficientnet, nasnetlarge, googlenet, inceptionresnetv2, inceptionv3, mobilenetv2, nasnetmobile, Xception, squeezenet, resnet18, resnet50, resnet101, vgg16, and vgg19. The two-phase statistical analysis was Duncan's multiple range test, followed by the Wilcoxon signed-rank test is the second one. Again, in order to do a statistical analysis, nine different indicators, including “accuracy, sensitivity, specificity, precision, FPR, F1 Score, MCC, Kappa, and computing time”, were taken into consideration. After the execution of 17 CNN models and twophase statistical analysis, it was revealed that resnet101 is superior among CNN models for citrus fruit disease prediction.

In this paper, we study the performance of variants of well-known Convolutional Neural Network (CNN) architectures on different audio tasks. We show that tuning the Receptive Field (RF) of CNNs is crucial to their generalization. An insufficient RF limits the CNN's ability to fit the training data. In contrast, CNNs with an excessive RF tend to over-fit the training data and fail to generalize to unseen testing data. As state-of-the-art CNN architectures - in computer vision and other domains - tend to go deeper in terms of number of layers, their RF size increases and therefore they degrade in performance in several audio classification and tagging tasks. We study well-known CNN architectures and how their building blocks affect their receptive field. We propose several systematic approaches to control the RF of CNNs and systematically test the resulting architectures on different audio classification and tagging tasks and datasets. The experiments show that regularizing the RF of CNNs using our proposed approaches can drastically improve the generalization of models, out-performing complex architectures and pre-trained models on larger datasets. The proposed CNNs achieve state-of-the-art results in multiple tasks, from acoustic scene classification to emotion and theme detection in music to instrument recognition, as demonstrated by top ranks in several pertinent challenges (DCASE, MediaEval).