Bay Number Recognition Based on Deep Convolutional Recurrent Neural Network

Text recognition in natural scene images is a challenging problem in computer vision. Different than the optical character recognition (OCR), text recognition in natural scene images is more complex due to variations in text size, colors, fonts, orientations, complex backgrounds, occlusion, illuminations and uneven lighting conditions. In this paper, we propose a segmentation-free method based on a deep convolutional recurrent neural network to solve the problem of cursive text recognition, particularly focusing on Urdu text in natural scenes. Compared to the non-cursive scripts, Urdu text recognition is more complex due to variations in the writing styles, several shapes of the same character, connected text, ligature overlapping, stretched, diagonal and condensed text. The proposed model gets a whole word image as an input without pre-segmenting into individual characters, and then transforms into the sequence of the relevant features. Our model is based on three components: a deep convolutional neural network (CNN) with shortcut connections to extract and encode the features, a recurrent neural network (RNN) to decode the convolutional features, and a connectionist temporal classification (CTC) to map the predicted sequences into the target labels. To increase the text recognition accuracy further, we explore deeper CNN architectures like VGG-16, VGG-19, ResNet-18 and ResNet-34 to extract more appropriate Urdu text features, and compare the recognition results. To conduct the experiments, a new large-scale benchmark dataset of cropped Urdu word images in natural scenes is developed. The experimental results show that the proposed deep CRNN network with shortcut connections outperform than other network architectures. The dataset is publicly available and can be downloaded from <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://data.mendeley.com/datasets/k5fz57zd9z/1</uri> .

Interstitial lung disease (ILD) refers to a group of various abnormal inflammations of lung tissues and early diagnosis of these disease patterns is crucial for the treatment. Yet it is difficult to make an accurate diagnosis due to the similarity among the clinical manifestations of these diseases. In order to assist the radiologists, computer-aided diagnosis systems have been developed. Besides, the potential of deep convolutional neural networks (CNNs) is also expected to exert on the medical image analysis in recent years. In this paper, we design a new deep convolutional neural network (CNN) architecture to achieve the classification task of ILD patterns. Furthermore, we also propose a novel two-stage transfer learning (TSTL) method to deal with the problem of the lack of training data, which leverages the knowledge learned from sufficient textural source data and auxiliary unlabeled lung CT data to the target domain. We adopt the unsupervised manner to learn the unlabeled data, by which the objective function composed of the prediction confidence and mutual information are optimized. The experimental results show that our proposed CNN architecture achieves desirable performance and outperforms most of the state-of-the-art ones. The comparative analysis demonstrates the promising feasibility and advantages of the proposed two-stage transfer learning strategy as well as the potential of the knowledge learning from lung CT data. Graphical Abstract The framework of the proposed two-stage transfer learning method.

Faults that are often invisible to existing inspection methods can significantly impact the reliability and efficiency of Photovoltaic (PV) systems. This study introduces an innovative framework for identifying PV panel faults using advanced machine learning algorithms and thermal images captured by unmanned aerial vehicles. The proposed Deep Recurrent Convolutional Neural Network (DRCNN) combines the strengths of Recurrent Neural Networks (RNNs) for learning temporal sequences and Convolutional Neural Networks (CNNs) for feature extraction. The DRCNN is designed to analyze thermal images of PV panels by capturing spatial and temporal patterns associated with fault-induced anomalies, such as hot spots, cracked cells or broken electrical connections. By leveraging CNN layers to extract critical features from thermal images and RNN layers to model the temporal dependencies and variations in thermal processes over time, the proposed approach integrates thermal image data collected under diverse environmental conditions.This dual strategy not only identifies faults based on spatial features but forecasts potential fault progression or the End-of-Life (EoL) for the panels by analyzing the evolution of thermal anomalies. The research aims to develop a highly accurate and efficient system for preventive maintenance and early problem detection, thereby improving the efficiency and durability of PV systems.The results demonstrate the DRCNN model's effectiveness in detecting various types of defects and delivering highly accurate real-time fault detection. By incorporating both spatial and temporal information, the proposed model significantly outperforms existing methods providing more robust and reliable defect identification.

DRCNNTLe: A deep recurrent convolutional neural network with transfer learning through pre-trained embeddings for automated ICD coding.

A driver stress detection model via data augmentation based on deep convolutional recurrent neural network

Chaos Game Representation (CGR) is an emerging means of visualising and representing genomic and proteomic sequences. There exist many open questions related to its effective application to various computational tasks. In this work, we begin to address some of these questions by comparing four variants of the Chaos Game to generate CGR imagery as part of a multi-class classification task to identify the source organism for a given protein. We propose a novel nodal configuration for icosagon and 20-flake CGRs. Using two datasets, we performed fine-tuning using seven deep convolutional neural network (CNN) architectures and report modest performance over random among the 56 test conditions, highlighting certain shortcomings in effectively leveraging CGR in conjunction with deep CNN architectures. Many of the insights from this work will serve to orient subsequent protein-related studies involving CGR-based encoding and be generally applicable to disparate domains seeking to leverage CGR for sequence-type data.

As the aging of concrete structures becomes increasingly severe, crack detection has become a crucial aspect of maintaining their sustainable use. This paper investigates an automatic detection and analysis method for concrete cracks based on deep convolutional neural network architecture. The study utilized drones equipped with high-definition cameras to capture images of concrete structures such as bridges and roads, collecting over 10,000 original images containing cracks. Using Labelme software for point-by-point image annotation and applying data augmentation techniques like rotation and scaling, the dataset was expanded to 30,000 images to meet the requirements of deep learning model training. An improved AlexNet model was developed, replacing the fully connected layer with global average pooling to enhance robustness and reduce overfitting. The model achieved an average accuracy of 95.42% on the test set, outperforming traditional methods by 15%. The model also proved effective in noisy environments. Additionally, a semantic segmentation model based on Fully Convolutional Network (FCN) was introduced, incorporating atrous convolution and spatial pyramid pooling, achieving a pixel-level accuracy of 97.6%, surpassing benchmark models such as FCN and U-Net. The model accurately estimated crack width, with an error rate within ±2% compared to field measurements. This method improves detection efficiency and accuracy while reducing manual intervention, providing strong support for the maintenance of concrete structures.

Due to the advent of modern embedded systems and mobile devices with constrained resources, there is a great demand for incredibly efficient deep neural networks for machine learning purposes. There is also a growing concern of privacy and confidentiality of user data within the general public when their data is processed and stored in an external server which has further fueled the need for developing such efficient neural networks for real-time inference on local embedded systems. The scope of our work presented in this paper is limited to image classification using a convolutional neural network. A Convolutional Neural Network (CNN) is a class of Deep Neural Network (DNN) widely used in the analysis of visual images captured by an image sensor, designed to extract information and convert it into meaningful representations for real-time inference of the input data. In this paper, we propose a neoteric variant of deep convolutional neural network architecture to ameliorate the performance of existing CNN architectures for real-time inference on embedded systems. We show that this architecture, dubbed CondenseNeXt, is remarkably efficient in comparison to the baseline neural network architecture, CondenseNet, by reducing trainable parameters and FLOPs required to train the network whilst maintaining a balance between the trained model size of less than 3.0 MB and accuracy trade-off resulting in an unprecedented computational efficiency.

Recently the development of deep learning has been propelling the sheer growth of vision and speech applications on lightweight embedded and mobile systems. However, the limitation of computation resource and power delivery capability in embedded platforms is recognized as a significant bottleneck that prevents the systems from providing real-time deep learning ability, since the inference of deep convolutional neural networks (CNNs) and recurrent neural networks (RNNs) involves large quantities of weights and operations. Particularly, how to provide quality-of-services (QoS)-guaranteed neural network inference ability in the multitask execution environment of multicore SoCs is even more complicated due to the existence of resource contention. In this article, we present a novel deep neural network architecture, MV-Net, which provides performance elasticity and contention-aware self-scheduling ability for QoS enhancement in mobile computing systems. When the constraints of QoS, output accuracy, and resource contention status of the system change, MV-Net can dynamically reconfigure the corresponding neural network propagation paths and thus achieves an effective tradeoff between neural network computational complexity and prediction accuracy via approximate computing. The experimental results show that (1) MV-Net significantly improves the performance flexibility of current CNN models and makes it possible to provide always-guaranteed QoS in a multitask environment, and (2) it satisfies the quality-of-results (QoR) requirement, outperforming the baseline implementation significantly, and improves the system energy efficiency at the same time.

Introduction Catathrenia is a rare sleep-related breathing disorder characterized by recurrent monotonous groaning during sleep. The acoustic characteristics of groaning and snoring sounds have been investigated. This study aims to propose a deep convolutional neural network (CNN) for automatic binary classification. Methods This study consisted of 3728 episodes of groaning sounds and 4577 episodes of snoring sounds obtained from synchronized audio of full-night polysomnography. Four features extracted from log-scaled mel-spectrograms were used as input. The background gaussian noise and the time-shifting were used to augment the dataset. The dataset was randomly split into training (70%), validation (15%), and testing datasets (15%). A deep learning convolutional neural network architecture was trained and evaluated. Results The proposed CNN model achieves an accuracy of 95.0% on the binary classification of groaning and snoring sounds. The model attains a sensitivity/recall of 96.4%, a specificity of 93.4%, and an F1 score of 94.84%. Conclusion The proposed CNN architecture has performed well in the automatic binary classification of groaning and snoring sounds, which could reduce difficulties in acoustic analyses of groaning episode detection. The model needs to be verified with more audio data before it can be put into clinical use better. Support (if any)

In the future, vehicles will be equipped with increasingly advanced interactive intelligent electronic devices, which will induce drivers to conduct secondary tasks, thereby leading to distractions. Therefore, the detection and early warning of driver distraction are essential for improving driving safety and pose an important challenge in intelligent transportation systems. Previous studies used traditional machine learning and deep learning transfer models, which have the disadvantages of complicated and time-consuming manual feature engineering, strong subjectivity, and weak generalization performance. In this paper, we propose a fine-grained detection method for driver distraction based on neural architecture search. First, we design an automatic construction algorithm for deep convolutional neural networks based on neural architecture search, which automatically searches for the optimal deep convolutional neural network architecture without human involvement. In addition, we fuse driver-related multisource perception information, use an automatically constructed deep convolutional neural network to extract high-dimensional mapping features, and implement fine-grained detection of various types of driver distraction states. The results on a large-scale multimodal driver distraction dataset demonstrate that our method can efficiently search an optimal deep convolutional neural network, which can quickly converge, and can accurately detect the considered types of driver distraction states, the average detection accuracy reaches 99.7796%; moreover, it has satisfactory robustness.

Freezing of Gait (FOG) is an episodic absence of forward movement in Parkinson’s Disease (PD) patients and represents an onset of disabilities. FOG hinders daily activities and increases fall risk. There is high demand for automating the process of FOG detection due to its impact on health and well being of individuals. This work presents WiFreeze, a noninvasive, line of sight, and lighting agnostic WiFi-based sensing system, which exploits ambient 5G spectrum for detection and classification of FOG. The core idea is to utilize the amplitude variations of wireless Channel State Information (CSI) to differentiate between FOG and activities of daily life. A total of 225 events with 45 FOG cases are captured from 15 patients with the help of 30 subcarriers and classification is performed with a deep neural network. Multiresolution scalograms are proposed for time–frequency signatures of human activities, due to their ability to capture and detect transients in CSI signals caused by transitions in human movements. A very deep Convolutional Neural Network (CNN), VGG-8K, with 8K neurons each, in fully connected layers is engineered and proposed for transfer learning with multiresolution scalogram features for detection of FOG. The proposed WiFreeze system outperforms all existing wearable and vision-based systems as well as deep CNN architectures with the highest accuracy of 99.7% for FOG detection. Furthermore, the proposed system provides the highest classification accuracies of 94.3% for voluntary stop and 97.6% for walking slow activities, with improvements of 9% and 23%, respectively, over the best performing state-of-the-art deep CNN architecture.

In this paper, an efficient deep convolutional neural network (CNN) architecture is proposed based on depthwise temporal convolution along with a robust end-to-end scheme to automatically detect and classify arrhythmia from denoised electrocardiogram (ECG) signal, which is termed as `DeepArrNet'. Firstly, considering the variational pattern of wavelet denoised ECG data, a realistic augmentation scheme is designed that offers a reduction in class imbalance as well as increased data variations. A structural unit, namely PTP (Pontwise-Temporal-Pointwise Convolution) unit, is designed with its variants where depthwise temporal convolutions with varying kernel sizes are incorporated along with prior and post pointwise convolution. Afterward, a deep neural network architecture is constructed based on the proposed structural unit where series of such structural units are stacked together while increasing the kernel sizes for depthwise temporal convolutions in successive units along with the residual linkage between units through feature addition. Moreover, multiple depthwise temporal convolutions are introduced with varying kernel sizes in each structural unit to make the process more efficient while strided convolutions are utilized in the residual linkage between subsequent units to compensate the increased computational complexity. This architecture provides the opportunity to explore the temporal features in between convolutional layers more optimally from different perspectives utilizing diversified temporal kernels. Extensive experimentations are carried out on two publicly available datasets to validate the proposed scheme that results in outstanding performances in all traditional evaluation metrics outperforming other state-of-the-art approaches.

The aim of this study is to evaluate whether we could develop a machine learning method to distinguish models of cerebrospinal fluid shunt valves (CSF-SVs) from their appearance in clinical X-rays. This is an essential component of an automatic MRI safety system based on X-ray imaging. To this end, a retrospective observational study using 416 skull X-rays from unique subjects retrieved from a clinical PACS system was performed. Each image included a CSF-SV representing the most common brands of programmable shunt valves currently used in US which were split into five different classes. We compared four machine learning pipelines: two based on engineered image features (Local Binary Patterns and Histogram of Oriented Gradients) and two based on features learned by a deep convolutional neural network architecture. Performance is evaluated using accuracy, precision, recall and f1-score. Confidence intervals are computed with non-parametric bootstrap procedures. Our best performing method identified the valve type correctly 96% [CI 94–98%] of the time (CI: confidence intervals, precision 0.96, recall 0.96, f1-score 0.96), tested using a stratified cross-validation approach to avoid chances of overfitting. The machine learning pipelines based on deep convolutional neural networks showed significantly better performance than the ones based on engineered image features (mean accuracy 95–96% vs. 56–64%). This study shows the feasibility of automatically distinguishing CSF-SVs using clinical X-rays and deep convolutional neural networks. This finding is the first step towards an automatic MRI safety system for implantable devices which could decrease the number of patients that experience denials or delays of their MRI examinations.

Foster the mechanical design of artificial vision requires a delicate balance between high-level analytical methods and the discovery through metaheuristics of near-optimal functions working towards complex visual problems. Evolutionary computation and swarm intelligence have developed strategies that automatically design meaningful deep convolutional neural network architectures to create better image classifiers. However, these architectures have not surpassed hand-craft models working with outdated problems with datasets of icon images. Nowadays, recent concerns about deep convolutional neural networks to adversarial attacks in the form of modifications to the input image can manipulate their output to make them untrustworthy. Brain programming is a hyper-heuristic whose aim is to work at a higher level of abstraction to develop automatically artificial visual cortex algorithms for a problem domain like image classification. This work's primary goal is to employ brain programming to design an artificial visual cortex to produce accurate and robust image classifiers in two problems. We analyze the final models designed by brain programming with the assumption of fooling the system using two adversarial attacks. In both experiments, brain programming constructed artificial brain models capable of competing with hand-crafted deep convolutional neural networks without any influence in the predictions when an adversarial attack is present.