ECG classification using 1-D convolutional deep residual neural network

Heartbeat classification using deep residual convolutional neural network from 2-lead electrocardiogram

The study presents the results of the development and testing of deep learning neural network architectures, which demonstrate high accuracy rates in classifying neurophysiological data, in particular hemodynamic brain activation patterns obtained by functional near-infrared spectroscopy, during solving mathematical problems on spatial-numerical associations. The analyzed signal represents a multidimensional time series of oxyhemoglobin and deoxyhemoglobin dynamics. Taking the specificity of the fNIRS signal into account, a comparative analysis of 2 types of neural network architectures was carried out: (1) architectures based on recurrent neural networks: recurrent neural network with long short-term memory, recurrent neural network with long short-term memory with fully connected layers, bidirectional recurrent neural network with long short-term memory, convolutional recurrent neural network with long short-term memory; (2) architectures based on convolutional neural networks with 1D convolutions: convolutional neural network, fully convolutional neural network, residual neural network. Trained long short-term memory recurrent neural network architectures showed worse results in accuracy in comparison with 1D convolutional neural network architectures. Residual neural network (model_Resnet) demonstrated the highest accuracy rates in three experimental conditions more than 88% in detecting age-related differences in brain activation during spatial-numerical association tasks considering the individual characteristics of the respondents’ signal.

An end-to-end deep convolutional neural network (CNN) based on deep residual network (ResNet) was proposed to efficiently reconstruct reliable T2 mapping from single-shot overlapping-echo detachment (OLED) planar imaging. The training dataset was obtained from simulations that were carried out on SPROM (Simulation with PRoduct Operator Matrix) software developed by our group. The relationship between the original OLED image containing two echo signals and the corresponding T2 mapping was learned by ResNet training. After the ResNet was trained, it was applied to reconstruct the T2 mapping from simulation and in vivo human brain data. Although the ResNet was trained entirely on simulated data, the trained network was generalized well to real human brain data. The results from simulation and in vivo human brain experiments show that the proposed method significantly outperforms the echo-detachment-based method. Reliable T2 mapping with higher accuracy is achieved within 30 ms after the network has been trained, while the echo-detachment-based OLED reconstruction method took approximately 2 min. The proposed method will facilitate real-time dynamic and quantitative MR imaging via OLED sequence, and deep convolutional neural network has the potential to reconstruct maps from complex MRI sequences efficiently.

The neuron classification problem is significant for understanding structure-function relationships in computational neuroscience. Advances in recent years have accelerated the speed of data collection, resulting in a large amount of data on the geometric, morphological, physiological, and molecular characteristics of neurons. These data encourage researchers to strive for automated neuron classification through powerful machine learning techniques. This paper extracts a statistical dataset of 43 geometrical features obtained from 116 human neurons, and proposes a neuronal morphology classification approach based on deep residual neural networks with feature scaling. The approach is applied to classify 18 types of human neurons and compares the accuracy of different number of residual block. Then, we also compare the accuracy between the proposed approach and other mainstream machine learning approaches, the classification accuracy of our approach is 100% in the training set and the testing set accuracy is 76.96%. The experimental results show that the deep residual neural network model has better classification accuracy for human neurons.

Some industrial processes take place in confined settings only observable by sensors, e.g. infrared (IR) cameras. Drying processes take place while a material is transported by means of a conveyor through a black box equipped with internal IR cameras. While such sensors deliver data at high rates, this is beyond what human operators can analyze and calls for automation. Inspired by numerous implementations monitoring techniques that analyse IR images using deep learning, this paper shows how they can be applied to the confined microwave drying of porous foams, with benchmarking their effectiveness at condition monitoring to conduct fault detection. Convolutional neural networks, derived transfer learning, and deep residual neural network methods are already regarded as cutting-edge and are studied here, using a set of conventional approaches for comparative evaluation. Our comparison shows that state-of-the-art deep learning techniques significantly benefit condition monitoring, providing an increase in fault finding accuracy of up to 48% over conventional methods. Nevertheless, we also found that derived transfer learning and deep residual network techniques do not in our case yield increased performance over normal convolutional neural networks.

Automated image classification is an essential task of the computer vision field. The tagging of images into a set of predefined groups is referred to as image classification. The implementation of computer vision to automate image classification would be beneficial because manual image evaluation and identification can be time-consuming, particularly when there are many images of different classes. Deep learning approaches are proven to overperform existing machine learning techniques in many fields in recent years, and computer vision is one of the most notable examples. The very deep neural network (VDCNN) is a powerful deep learning model for image classification, and this paper examines it briefly using MNIST handwritten digit dataset. This dataset is used to prove the efficacy of very deep neural networks over other deep learning models. The proposed study aims to comprehend the very deep neural network architecture used to accomplish a handwritten digit recognition task. The feasibility of the proposed model is evaluated using mean accuracy, validation accuracy, and standard deviation. The study results of the very deep neural network model are compared to a convolutional neural network and convolutional neural network with batch normalization. According to the results of the comparison study, very deep neural networks achieve high accuracy of 99.1% for a handwritten dataset. The outcome of the proposed work is used to interpret how well a very deep neural network performs when compared to the other two models of deep neural networks. This proposed architecture may be used to automate the classification of handwritten digits dataset.

Background Incidence rate of thyroid cancer is steadily increasing due to overdiagnosis and overtreatment. Thyroid ultrasound is commonly used to diagnose thyroid cancer. The aim of this study is to examine the accuracy of using deep convolutional neural network (DCNN) models to improve diagnosis of thyroid cancer by analyzing sonographic imaging data from clinical thyroid ultrasound. Methods A total of 131,731 sonographic images from 17,627 thyroid cancer patients and 180,668 sonographic images from 25,325 controls used as training set were obtained from Tianjin Cancer Hospital. Images from anatomical sites that did not have cancer according to location sign on the image were not included. All thyroid cancer patients and 13·2% of controls (51,255 images) were confirmed by pathological reports. DCNN is a specific type of neural network optimized for image recognition. We trained two DCNN models on the training set and subsequently evaluated the performance on one independent internal (Tianjin, 1,118 individuals) and two external (Jilin,154 individuals; Weihai, 1,420 individuals) validation sets. Individuals in the validation sets all have pathological examinations. We compared the specificity/sensitivity of DCNN models with the performance of six thyroid ultrasound radiologists on these three validation sets. Findings DCNN model achieved high performance in identifying thyroid cancer patients versus six experience radiologists: for Tianjin validation set, sensitivity was 92·2% versus 96·9% (95% CI 89·7% - 94·3% vs. 93·9% - 98·6%; p = 0·003), and specificity was 85·6% versus 59·4% (95% CI 82·4% - 88·4% vs. 53% - 65·6%; p < 0·0001); for Jilin validation set, sensitivity was 84·3% versus 92·9% (95% CI 73·6% - 91·9% vs. 84·1% - 97·6%; p = 0·05), and specificity was 86·9% versus 57·1% (95% CI 77·8% - 93·3% vs. 45·9% - 67·9%; p < 0·0001); for Weihai validation set, sensitivity was 84·5% versus 89% (95% CI 81·2% - 87·4% vs. 81·9% - 94%; p = 0·2), and specificity was 87·5% versus 68·6% (95% CI 85·1% - 89·6% vs. 60·7% - 75·8%; p < 0·0001). Interpretation DCNN models exhibited high accuracy, sensitivity, and specificity in identifying thyroid cancer patients at levels comparable to or higher than six experienced radiologists. Conferred by the high specificity of DCNN models, the rate of overdiagnosis and overtreatment of patients with thyroid cancer is expected to decrease. This supports future application of the deep learning models to clinical practice for thyroid cancer diagnosis. However, further validation of these DCNN models in prospective clinical trials is warranted. Funding The Program for Changjiang Scholars and Innovative Research Team in University in China (IRT_14R40), National Natural Science Foundation of China (31801117). Citation Format: Xiangchun Li, Sheng Zhang, Qiang Zhang, Xi Wei, Yi Pan, Jing Zhao, Xiaojie Xin, Xiaoqing Wang, Fan Yang, Jianxin Li, Meng Yang, Qinghua Wang, Xiangqian Zheng, Yanhui Zhao, Lun Zhang, Xudong Wang, Zhimin Zheng, Christopher T. Whitlow, Metin N. Gurcan, Boris Pasche, Ming Gao, Wei Zhang, Kexin Chen. Diagnosis of thyroid cancer using deep convolutional neural network models applied to sonographic images from clinical ultrasound exams [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2019; 2019 Mar 29-Apr 3; Atlanta, GA. Philadelphia (PA): AACR; Cancer Res 2019;79(13 Suppl):Abstract nr 1394.

AimsHeart failure (HF) is a leading cause of death. Early intervention is the key to reduce HF-related morbidity and mortality. This study assesses the utility of electrocardiograms (ECGs) in HF risk prediction.Methods and resultsData from the baseline visits (1987–89) of the Atherosclerosis Risk in Communities (ARIC) study was used. Incident hospitalized HF events were ascertained by ICD codes. Participants with good quality baseline ECGs were included. Participants with prevalent HF were excluded. ECG-artificial intelligence (AI) model to predict HF was created as a deep residual convolutional neural network (CNN) utilizing standard 12-lead ECG. The area under the receiver operating characteristic curve (AUC) was used to evaluate prediction models including (CNN), light gradient boosting machines (LGBM), and Cox proportional hazards regression. A total of 14 613 (45% male, 73% of white, mean age ± standard deviation of 54 ± 5) participants were eligible. A total of 803 (5.5%) participants developed HF within 10 years from baseline. Convolutional neural network utilizing solely ECG achieved an AUC of 0.756 (0.717–0.795) on the hold-out test data. ARIC and Framingham Heart Study (FHS) HF risk calculators yielded AUC of 0.802 (0.750–0.850) and 0.780 (0.740–0.830). The highest AUC of 0.818 (0.778–0.859) was obtained when ECG-AI model output, age, gender, race, body mass index, smoking status, prevalent coronary heart disease, diabetes mellitus, systolic blood pressure, and heart rate were used as predictors of HF within LGBM. The ECG-AI model output was the most important predictor of HF.ConclusionsECG-AI model based solely on information extracted from ECG independently predicts HF with accuracy comparable to existing FHS and ARIC risk calculators.

Artificial Intelligence (AI) has grown extensively in recent times and already encroaches into our lives, for example, with smart cars and smart homes. AI current and future trends in areas such as smart cars, face recognition, robotic surgeries, or automatic disease classification, focus on hybridization to improve the performance of smart expert systems. Despite the huge growth of various AI and machine learning techniques, such as decision trees, data mining, or deep convergence learning, there are still many challenges and threats which limit the performance of these smart expert systems. This special issue focuses on new directions in hybrid AI and machine learning methodologies to address current research problems. It focuses on bringing together leading-edge articles on hybrid AI techniques for smart expert systems for various applications. From about 25 articles submitted, 4 papers were selected based on the review process. Each paper was reviewed by at least two independent reviewers and undertook at least one round of review. Their contributions are summarized below. Raghavendra et al. (2019) has proposed a research work on accurate and early detection of breast cancer using effective imaging modalities with medical image analysis. The research results have shown that two-dimensional synthesized mammogram imaging and conventional full-field digital mammography (FFDM) are two important imaging modalities which can be used for screening breast cancer. The developed method achieved an average performance of 92.9% accuracy using a probabilistic neural network classifier for FFDM images with tenfold cross validation. The obtained results can be used as a distinct system in rural hospitals. Gupta et al. (2020) has done their research studies on to detect infected leaves using machine learning techniques. An improved artificial plant optimization (IAPO) algorithm using machine learning has been introduced that identifies the plant diseases and categorize the leaves into healthy and infected on a private data set of 236 images. The degree of infection is eventually computed, and the leaves with infection greater than a certain calculated threshold are classified as infected leaves. The results show that IAPO can be used for the classification of infected and healthy leaves and this algorithm can be generalized to solve problems in other domains as well. Hammad et al. (2020) has found a new authentication approach based on biometric modalities such as heartbeat pattern obtained from electrocardiogram (ECG) signals. This work shows two novel deep neural network (DNN) models (convolutional neural network (CNN) and ResNet-Attention) using ECG signals for human authentication and the proposed CNN algorithm achieved an accuracy of 98.59% and 99.72% using PTB and CYBHi, respectively. The results obtained by the developed model proved that the performance is better than existing algorithms and can be used in real-time authentication systems after the validation with more diverse ECG data. Teles et al. (2020) has devised a decision support system on credit operations which can provide different estimations of expected recovery based on the same data sets. This research work classifies credit by the formulation of a rule that describes the values of a categorical variable according to some specified definition. Results reveal that while linear regression can be used for the prediction of a continuous variable in the credit process using collateral, it is not suitable for categorical data. Out of linear and logistic regressions, linear regression is more applicable in determining groups of variables that can significantly predict an outcome. We would like to take this opportunity to thank Dr. Jon G. Hall, Editor-in-Chief of Expert Systems, The Journal of Knowledge Engineering, for the privilege to edit this special issue. Gustavo Ramírez González is a professor at department of telematics engineering in Universidad del Cauca, Colombia. His research interests include image processing, secure communication, and machine learning. He has published several research papers in reputed journals and served as a Guest Editor for several Special Issues at many journals.

We present PyMerger, a Python tool for detecting binary black hole (BBH) mergers from the Einstein Telescope (ET), based on a deep residual neural network (ResNet) model. ResNet was trained on data combined from all three proposed subdetectors of ET (TSDCD) to detect BBH mergers. Five different lower-frequency cutoffs (F low)—5 Hz, 10 Hz, 15 Hz, 20 Hz, and 30 Hz—with the match-filter signal-to-noise ratio (MSNR) ranges 4–5, 5–6, 6–7, 7–8, and >8 were employed in the data simulation. Compared to previous work that utilized data from a single subdetector, the detection accuracy from TSDCD has shown substantial improvements, increasing from 60%, 60.5%, 84.5%, 94.5%, and 98.5% to 78.5%, 84%, 99.5%, 100%, and 100% for sources with MSNRs of 4–5, 5–6, 6–7, 7–8, and >8, respectively. The ResNet model is evaluated on the first ET mock data challenge (ET-MDC1) data set, where the model demonstrates strong performance in detecting BBH mergers, identifying 5566 out of 6578 BBH events, with optimal SNRs starting from 1.2 and a minimum and maximum D L of 0.5 Gpc and 148.95 Gpc, respectively. Despite being trained only on BBH mergers without overlapping sources, the model achieves high BBH detection rates. Notably, even though the model was not trained on binary neutron star (BNS) and black hole-neutron star (BHNS) mergers, it successfully detected 11,477 BNS and 323BHNS mergers in ET-MDC1, with optimal SNRs starting from 0.2 and 1, respectively, indicating its potential for broader applicability.

Land cover and its dynamic information is the basis for characterizing surface conditions, supporting land resource management and optimization, and assessing the impacts of climate change and human activities. In land cover information extraction, the traditional convolutional neural network (CNN) method has several problems, such as the inability to be applied to multispectral and hyperspectral satellite imagery, the weak generalization ability of the model and the difficulty of automating the construction of a training database. To solve these problems, this study proposes a new type of deep convolutional neural network based on Landsat-8 Operational Land Imager (OLI) imagery. The network integrates cascaded cross-channel parametric pooling and average pooling layer, applies a hierarchical sampling strategy to realize the automatic construction of the training dataset, determines the technical scheme of model-related parameters, and finally performs the automatic classification of remote sensing images. This study used the new type of deep convolutional neural network to extract land cover information from Qinhuangdao City, Hebei Province, and compared the experimental results with those obtained by traditional methods. The results show that: (1) The proposed deep convolutional neural network (DCNN) model can automatically construct the training dataset and classify images. This model performs the classification of multispectral and hyperspectral satellite images using deep neural networks, which improves the generalization ability of the model and simplifies the application of the model. (2) The proposed DCNN model provides the best classification results in the Qinhuangdao area. The overall accuracy of the land cover data obtained is 82.0%, and the kappa coefficient is 0.76. The overall accuracy is improved by 5% and 14% compared to the support vector machine method and the maximum likelihood classification method, respectively.

Introduction Catathrenia is a rare sleep-related breathing disorder characterized by recurrent monotonous groaning during sleep. The acoustic characteristics of groaning and snoring sounds have been investigated. This study aims to propose a deep convolutional neural network (CNN) for automatic binary classification. Methods This study consisted of 3728 episodes of groaning sounds and 4577 episodes of snoring sounds obtained from synchronized audio of full-night polysomnography. Four features extracted from log-scaled mel-spectrograms were used as input. The background gaussian noise and the time-shifting were used to augment the dataset. The dataset was randomly split into training (70%), validation (15%), and testing datasets (15%). A deep learning convolutional neural network architecture was trained and evaluated. Results The proposed CNN model achieves an accuracy of 95.0% on the binary classification of groaning and snoring sounds. The model attains a sensitivity/recall of 96.4%, a specificity of 93.4%, and an F1 score of 94.84%. Conclusion The proposed CNN architecture has performed well in the automatic binary classification of groaning and snoring sounds, which could reduce difficulties in acoustic analyses of groaning episode detection. The model needs to be verified with more audio data before it can be put into clinical use better. Support (if any)

Recent studies have demonstrated that a well designed deep convolutional neural network (CNN) model achieves competitive performances on detecting the presence of secret message in digital images, compared with the classical rich model based steganalysis. In this paper, we propose to investigate a category of very deep CNN model–the deep residual network (DRN), for steganalysis. DRN is suitable for steganalysis from two aspects. For the first, the DRN model usually contains a large number of network layers, which proves to be effective to capture the complex statistics of digital images. For the second, DRN's residual learning (ResL) method actively strengthens the signal coming from secret messages, which is extremely beneficial for the discrimination between cover images and stego images. Comprehensive experiments on standard dataset show that the DRN model achieves very low detection error rates for the state of arts steganographic algorithms. It also outperforms the classical rich model method and several recently proposed CNN based methods.

Abnormal target detection in hyperspectral remote sensing image is one of the hotspots in image research. The image noise generated in the detection process will lead to the decline of the quality of hyperspectral remote sensing image. In view of this, this paper proposes an abnormal target detection method of hyperspectral remote sensing image based on the convolution neural network. Firstly, the deep residual learning network model has been used to remove the noise in hyperspectral remote sensing image. Secondly, the spatial and spectral features of hyperspectral remote sensing images were used to optimize the clustering dictionary, and then the image segmentation containing target information is completed. Finally, the image was input into the deep convolution neural network with a dual classifier, and the network detects the abnormal target in the image. The test results of this algorithm show that the structural similarity of the denoised image is higher than 0.86, which shows that this method has good noise reduction performance, image details will not damage, segmentation effect is good, and it can obtain high-definition target image information and accurately detect abnormal targets in the image.

As road traffic sign recognition is a crucial component for automatic driver assistance systems, it is a key problem in computer vision as well. Therefore, in this paper, we study on the problem of road traffic sign recognition utilising the computer vision technology. The main innovation of this paper is to propose an improved convolutional neural network, and then use it to tackle the road traffic sign recognition problem. Convolutional neural network can learn features from training data set, and a convolutional network contains alternating layers of convolution and pooling. Particularly, RGB traffic images are transformed to grey scale images, and then grey scale images are input to the improved convolutional neural network. Furthermore, the fixed layers are utilised to discover region of interests, and the learnable layers are used to extract features. In general, output information of the proposed two learnable layers are input to the classifier separately, and parameters of learnable layers and the classifier are trained at the same time. Finally, GTSDB data set is chosen to make performance evaluation, among which 600 images and 300 images are regarded as training and testing data set respectively. Experimental results demonstrate that the improved CNN-based traffic sign recognition performs better than the traditional CNN.