Assessing Deep Convolutional Neural Networks and Assisted Machine Perception for Urban Mapping

Deep learning models are highly parameterized, resulting in difficulty in inference and transfer learning for image recognition tasks. In this work, we propose a layered pathway evolution method to compress a deep convolutional neural network (DCNN) for classification of masses in digital breast tomosynthesis (DBT). The objective is to prune the number of tunable parameters while preserving the classification accuracy. In the first stage transfer learning, 19 632 augmented regions-of-interest (ROIs) from 2454 mass lesions on mammograms were used to train a pre-trained DCNN on ImageNet. In the second stage transfer learning, the DCNN was used as a feature extractor followed by feature selection and random forest classification. The pathway evolution was performed using genetic algorithm in an iterative approach with tournament selection driven by count-preserving crossover and mutation. The second stage was trained with 9120 DBT ROIs from 228 mass lesions using leave-one-case-out cross-validation. The DCNN was reduced by 87% in the number of neurons, 34% in the number of parameters, and 95% in the number of multiply-and-add operations required in the convolutional layers. The test AUC on 89 mass lesions from 94 independent DBT cases before and after pruning were 0.88 and 0.90, respectively, and the difference was not statistically significant (p > 0.05). The proposed DCNN compression approach can reduce the number of required operations by 95% while maintaining the classification performance. The approach can be extended to other deep neural networks and imaging tasks where transfer learning is appropriate.

We developed a computer-aided diagnosis (CADx) method for classification between benign nodule, primary lung cancer, and metastatic lung cancer and evaluated the following: (i) the usefulness of the deep convolutional neural network (DCNN) for CADx of the ternary classification, compared with a conventional method (hand-crafted imaging feature plus machine learning), (ii) the effectiveness of transfer learning, and (iii) the effect of image size as the DCNN input. Among 1240 patients of previously-built database, computed tomography images and clinical information of 1236 patients were included. For the conventional method, CADx was performed by using rotation-invariant uniform-pattern local binary pattern on three orthogonal planes with a support vector machine. For the DCNN method, CADx was evaluated using the VGG-16 convolutional neural network with and without transfer learning, and hyperparameter optimization of the DCNN method was performed by random search. The best averaged validation accuracies of CADx were 55.9%, 68.0%, and 62.4% for the conventional method, the DCNN method with transfer learning, and the DCNN method without transfer learning, respectively. For image size of 56, 112, and 224, the best averaged validation accuracy for the DCNN with transfer learning were 60.7%, 64.7%, and 68.0%, respectively. DCNN was better than the conventional method for CADx, and the accuracy of DCNN improved when using transfer learning. Also, we found that larger image sizes as inputs to DCNN improved the accuracy of lung nodule classification.

One of the most powerful ideas in deep learning is the transfer learning technique. Transfer learning can be utilized to take a knowledge from what a deep neural network has learned from a particular task and apply that knowledge to a different task. Transfer learning is very useful when the size of the training samples of interest is small to train a neural network from scratch. This research focuses on the concept of transfer learning where the Convolutional Neural Network (CNN) power can be utilized as a features extractor to help with classifying benign from malignant breast cancer images. In addition, Support Vector Machine (SVM) classifier based on Radial Basis Function (RBF) was adapted for its flexibility in fitting the data dimension space adequately by tuning the kernel width. The hybridization between CNN and RBF-Based SVM showed robust results for both the dataset and the application task of this research. The contribution of this paper can be summarized in three major parts. First, a CNN was implemented from scratch on a large number of available spine images to classify images of two different spine views (sagittal and axial) in order to transfer the learning process to the CNN of breast images. Second, retrain the spine CNN on the images of breast cancer to classify between benign and malignant cases by fine-tuning. Finally, the features were extracted from the retrained CNN and fed to RBF-Based SVM to classify benign from malignant breast mammogram images.

Self-mixing interferometry (SMI) is superior to other laser interferometry methods due to its simplicity and compactness. However, SMI signals are often complex and difficult to process due to interference in the form of variations in the effective reflectivity of the target, noisy signals, complex signal shapes, and other dependencies. Deep neural networks have been a very popular area of research in computer artificial intelligence in recent years, allowing more implicit features to be uncovered than traditional shallow machine learning. It has been shown that convolutional and back-propagation neural networks can be used for SMI signal processing. There are also studies that have used machine learning genetic algorithms for absolute distance measurement. Based on the above, this study used convolutional neural networks to form a deep neural network for absolute distance measurement based on SMI technology. We first trained the deep convolutional neural network at different feedback strengths. The results of the Convolutional Neural Network (CNN) model showed a coefficient of determination of 0.9987. which is consistent with the required model. The trained network was then used to estimate absolute distances with and without the addition of noise. The comparison proves that the proposed method is noise-proof and has high adaptability for measurements under different conditions.

The leather industry plays a crucial role in the production of high-quality leather products to remain competitive in the market. Due to various reasons such as material handling and turning, leather defects can appear at different stages of the production process. This paper proposed deep learning techniques, specifically transfer learning, deep convolutional neural networks (D-CNN), and ensemble learning for automating leather defect detection and classification. The dataset was taken from the open source Kaggle. The dataset was preprocessed from the beginning. However, we performed Error Level Analysis (ELA) to detect possible changes or fraud in the image. We also used data augmentation techniques (resizing, rescaling, flipping, rotation, zooming, and contrasting) on the dataset to improve the model performance. This study investigated deep learning architectures for automatic leather defect detection, comparing them with seven deep convolutional neural networks (D-CNN) models and transfer learning architectures. Furthermore, we introduce and evaluate two novel ensemble models: MER built on transfer learning architecture (MobileNetV2, EfficientNetB0, and ResNet50) and AZL built on D-CNN architecture (AlexNet, ZfNet, and LeNet). A key contribution of this study is the demonstration of significant performance improvements achieved by strategically integrating squeeze and excitation and label smoothing techniques into transfer learning, D-CNN, and ensemble frameworks. Our proposed MER ensemble method achieves a state-of-the-art of 96.39% for leather defect detection. The proposed model was evaluated using performance metrics including precision, recall, F1-score, AUC, ROC, and Matthews Correlation Coefficient (MCC). Additionally, Grad-CAM was employed for explainable AI to visualize and interpret the model’s decision-making process. Comparative analysis against separate transfer learning and D-CNN models fails to establish the superior performance of our MER ensemble, which highlights the potential to significantly advance automated quality inspection in leather production. This study provides insights into evaluating the best deep learning techniques for leather defect classification, paving the way for more accurate, efficient, and reliable industrial applications. Proposes a robust deep learning-based framework for automated leather defect detection using transfer learning, deep CNNs, and two novel ensemble models (MER and AZL), enhanced with squeeze-and-excitation and label smoothing techniques. Achieves state-of-the-art performance with the proposed MER ensemble model, achieve 96.39% accuracy, and demonstrates superior results across precision, recall, F1-score, AUC–ROC, and MCC. Integrates Error Level Analysis (ELA), extensive data augmentation, and Grad-CAM–based explainable AI to ensure data reliability, improve generalization, and provide transparent visual interpretation of defect regions for industrial quality inspection.

Identification of crops is an important topic in the agricultural domain. Hyperspectral remote sensing data are very useful for crop feature extraction and classification. Remote sensing data is an unstructured data and Convolutional Neural Network (CNN) can work on unstructured data efficiently. This paper presents an evaluation of CNN for crop classification using the Indian Pines standard dataset obtained from the AVIRIS sensor and the study area dataset obtained from the EO-1hyperion sensor. Optimized CNN has been tuned by training the model on different parameters. It has been compared with two classification algorithms: Deep Neural Network (DNN) and Convolutional Autoencoder. According to the test results, the proposed optimized CNN model provided better results as compared to the other two methods. CNN has given 97 ± 0.58% overall accuracy for the Indian Pines standard dataset and 78 ± 2.43% for our study area dataset.

Evaluation of the benchmark datasets for testing the efficacy of deep convolutional neural networks

Deep Convolutional Neural Networks for Large-scale Speech Tasks

paper, we focus on exploring the relationship between weave patterns and their mechanical properties in woven fiber composites through Machine Learning. Specifically, we explore the interactions between woven architectures and in-plane stiffness properties through Deep Convolutional Neural Network (DCNN) and Generative Adversarial Network (GAN). Our research is important for exploring how woven composite’s pattern is related to its mechanical properties and accelerating woven composite design as well as optimization. We focus on two tasks: (1) Stiffness prediction: Predicting in-plane stiffness properties for given weave patterns. Our DCNN extracts high-level features through several convolutional and fully connected layers to determine the final predictions. (2) Weave pattern prediction: Predicting weave patterns for target stiffness properties, which can be treated as the reverse task of the first one. Due to many-to-one mapping between weave patterns and the composite properties, we utilize a Decoder Neural Network as our baseline model and compare its performance with GAN and Genetic Algorithm. We represent the weave patterns as 2D checkerboard models and use finite element analysis (FEA) to determine in-plane stiffness properties, which serve as input data for our ML framework. We show that: (1) for stiffness prediction, DCNN can predict stiffness values for a given weave pattern with relatively high accuracy (above 93%); (2) for weave pattern prediction, the GAN model gives the best prediction accuracy (above 92%) while Decoder Neural Network has the best time efficiency. HAOTIAN FENG

Reservoir characterization through seismic data analysis is essential for exploration and production in the petroleum industry. However, seismic-to-well tie discrepancies, limited availability of high-quality well data, and resolution constraints pose a reliability challenge. While previous studies offer valuable insights, they still struggle to achieve high-resolution predictions in a complex geologically environment given high reliance on well data. This study integrates synthetic data-driven techniques with real data, including convolutional neural networks (CNN) and transfer learning, to improve seismic reservoir characterization. We utilize nearby well statistics and a rock physics model (RPM) to simulate pseudo wells representing various geological scenarios. Synthetic seismic gathers are generated from these pseudo wells, which are based on RPM and local well control, to train the CNN. Transfer learning is then applied to adapt the CNN to better distinguish between real and synthetic data, enhancing reservoir predictions. A comparative analysis of P-impedance predictions from three methodologies: theory-driven Pre-Stack-Seismic-Inversion (TDSI), Deep-Neural-Network (DNN), and our CNN approach, showed that CNN achieved nearly 97% prediction accuracy with low error rates, compared to relatively lower prediction accuracy rates of DNN (86.2%) and TDSI (81.5%) with high error rates, according to robust metrics including R-square, RMSE, MSE, and MAE. These results indicate that CNN not only enhanced resolution but also closely aligned with well data and superior lateral continuity, even in blind well scenarios. This study effectively integrates synthetic data-driven techniques with CNNs and transfer learning to advance seismic reservoir property prediction, offering a robust solution to overcome limitations in traditional and DNN-based approaches.

Deep convolutional neural networks with ensemble learning and transfer learning for capacity estimation of lithium-ion batteries

Deep convolutional neural networks have become a dominant solution for numerous image classification tasks. However, a main criticism is the poor explainability due to the black-box characteristic, which hurdles the extensive usage of deep convolutional neural networks. To address this issue, this paper proposes a new evolutionary multi-objective based method, which aims to explain the behaviours of deep convolutional neural networks by evolving local explanations on specific images. To the best of our knowledge, this is the first evolutionary multi-objective method to evolve local explanations. The proposed method is model-agnostic, i.e. it is applicable to explain any deep convolutional neural networks. ImageNet is used to examine the effectiveness of the proposed method. Three well-known deep convolutional neural networks -VGGNet, ResNet, and MobileNet, are chosen to demonstrate the modelagnostic characteristic. Based on the experimental results, it can be observed that the local explanations are understandable to end-users, who need to check the sensibility of the evolved explanations to decide whether to trust the predictions made by the deep convolutional neural networks. Furthermore, the local explanations evolved by the proposed method improves the confidence of deep convolutional neural networks making the predictions. Lastly, the pareto front and convergence analyses indicate that the proposed method can form a good set of nondominated solutions.

Text recognition in natural scene images is a challenging problem in computer vision. Different than the optical character recognition (OCR), text recognition in natural scene images is more complex due to variations in text size, colors, fonts, orientations, complex backgrounds, occlusion, illuminations and uneven lighting conditions. In this paper, we propose a segmentation-free method based on a deep convolutional recurrent neural network to solve the problem of cursive text recognition, particularly focusing on Urdu text in natural scenes. Compared to the non-cursive scripts, Urdu text recognition is more complex due to variations in the writing styles, several shapes of the same character, connected text, ligature overlapping, stretched, diagonal and condensed text. The proposed model gets a whole word image as an input without pre-segmenting into individual characters, and then transforms into the sequence of the relevant features. Our model is based on three components: a deep convolutional neural network (CNN) with shortcut connections to extract and encode the features, a recurrent neural network (RNN) to decode the convolutional features, and a connectionist temporal classification (CTC) to map the predicted sequences into the target labels. To increase the text recognition accuracy further, we explore deeper CNN architectures like VGG-16, VGG-19, ResNet-18 and ResNet-34 to extract more appropriate Urdu text features, and compare the recognition results. To conduct the experiments, a new large-scale benchmark dataset of cropped Urdu word images in natural scenes is developed. The experimental results show that the proposed deep CRNN network with shortcut connections outperform than other network architectures. The dataset is publicly available and can be downloaded from <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://data.mendeley.com/datasets/k5fz57zd9z/1</uri> .

In the indoor environment, the activity of the pedes-trian can reflect some semantic information, for example, if a user’s activity is recognized as taking elevator, the location of the user is inferred to be in the elevator. These activities can be used as the landmarks for indoor localization. The development of sensor technology enhances the smartphone’s sensing and computational capabilities. Using the smartphones, the activity of the pedestrian can be recognized. Current methods rely on extracting complex hand-crafted features, thus leading to the incapability of real time pedestrian activities identification. In this paper, we propose a real time pedestrian activities recognition method based on deep convolutional neural network. A new deep convolutional neural (CNN) network has been designed to learn the proper features automatically. Experiments show that the proposed method achieves approximately 95.21% accuracy in about 2 seconds in identifying nine types of activities, including still, walk, upstairs, up elevator, up escalator, down elevator, down escalator, downstairs and turning. Besides, we transplant the activity recognition algorithm to smartphones using tensorflow. Moreover, we have built a pedestrian activity database, which contains more than 6 GB data of accelerometer, magnetometer, gyroscope and barometer collected with various types of smartphones. We will make it public to contribute the academic research.

Maxout neurons for deep convolutional and LSTM neural networks in speech recognition