A Preliminary Study on Assessing Patient Behavioral Quality Using Deep Learning

Cardiovascular diseases rank the highest among diseases in terms of mortality rate and cause millions of deaths every year. Heart failure is a type of cardiovascular disease and its early diagnosis is extremely important for its prevention. It may be vitally important to understand to what extent which body values, characteristics and factors (age, gender, blood pressure, sugar, etc.) affect this disease and to predict whether the individual will have a possible heart attack in the future. In this study, firstly, the correlation level of the relevant body values with the disease is extracted and in the second stage, a method that predicts heart attack with DNN (Deep Neural Network) and CNN (Convolutional Neural Network) deep learning models is proposed. In the study, 918 observations obtained from the kaggle site were used. Firstly, missing data, categorical data, non-numerical features were checked. Then, outliers were cleaned and the relationship of the features in the dataset with the disease state was revealed by feature engineering operations on the data. Finally, deep neural network models were built and the model was trained and hyperparameter adjustment was performed with GridSearhCV to achieve the highest success rate. As a result of the study, Accuracy, Precision, Recall and F1-Score values were found as 0.9375, 0.9629, 0.9176, 0.9397 for DNN and 0.9312, 0.9512, 0.9176, 0.9340 for CNN respectively. The AUC value calculated from the ROC curve was found to be equal to 0.96 in both deep learning models.

Simple SummaryThe growing evidence suggested that competing endogenous RNAs (ceRNAs) have significant associations with tumor occurrence and progression, yet the regulatory mechanism of them in lung adenocarcinoma remains unclear. Identification of the regulatory modules for lung adenocarcinoma is a critical and fundamental step towards understanding the regulatory mechanisms during carcinogenesis. Deep neural network (DNN) models have become a powerful tool to intelligently recognize the sophisticated relationships of ceRNAs appropriately. In this paper, multiple deep neural network models were constructed using the expression data to identify regulatory modules for lung adenocarcinoma in biological networks. Three identified regulatory modules association with lung adenocarcinoma were validated from three aspects, i.e., literature review, functional enrichment analysis, and an independent dataset. The regulatory relationships between RNAs were validated in various datasets, including CPTAC, TCGA and an expression profile from the GEO database. Our study will contribute to improving the understanding of regulatory mechanisms in the carcinogenesis of lung adenocarcinoma and provide schemes for identifying novel regulatory modules of other cancers.Lung adenocarcinoma is the most common type of primary lung cancer, but the regulatory mechanisms during carcinogenesis remain unclear. The identification of regulatory modules for lung adenocarcinoma has become one of the hotspots of bioinformatics. In this paper, multiple deep neural network (DNN) models were constructed using the expression data to identify regulatory modules for lung adenocarcinoma in biological networks. First, the mRNAs, lncRNAs and miRNAs with significant differences in the expression levels between tumor and non-tumor tissues were obtained. MRNA DNN models were established and optimized to mine candidate mRNAs that significantly contributed to the DNN models and were in the center of an interaction network. Another DNN model was then constructed and potential ceRNAs were screened out based on the contribution of each RNA to the model. Finally, three modules comprised of miRNAs and their regulated mRNAs and lncRNAs with the same regulation direction were identified as regulatory modules that regulated the initiation of lung adenocarcinoma through ceRNAs relationships. They were validated by literature and functional enrichment analysis. The effectiveness of these regulatory modules was evaluated in an independent lung adenocarcinoma dataset. Regulatory modules for lung adenocarcinoma identified in this study provided a reference for regulatory mechanisms during carcinogenesis.

Objective. Epidermal growth factor receptor (EGFR) mutation genotyping plays a pivotal role in targeted therapy for non-small cell lung cancer (NSCLC). We aimed to develop a computed tomography (CT) image-based hybrid deep radiomics model to predict EGFR mutation status in NSCLC and investigate the correlations between deep image and quantitative radiomics features. Approach. First, we retrospectively enrolled 818 patients from our centre and 131 patients from The Cancer Imaging Archive database to establish a training cohort (N = 654), an independent internal validation cohort (N = 164) and an external validation cohort (N = 131). Second, to predict EGFR mutation status, we developed three CT image-based models, namely, a multi-task deep neural network (DNN), a radiomics model and a feature fusion model. Third, we proposed a hybrid loss function to train the DNN model. Finally, to evaluate the model performance, we computed the areas under the receiver operating characteristic curves (AUCs) and decision curve analysis curves of the models. Main results. For the two validation cohorts, the feature fusion model achieved AUC values of 0.86 ± 0.03 and 0.80 ± 0.05, which were significantly higher than those of the single-task DNN and radiomics models (all P < 0.05). There was no significant difference between the feature fusion and the multi-task DNN models (P > 0.8). The binary prediction scores showed excellent prognostic value in predicting disease-free survival (P = 0.02) and overall survival (P < 0.005) for validation cohort 2. Significance. The results demonstrate that (1) the feature fusion and multi-task DNN models achieve significantly higher performance than that of the conventional radiomics and single-task DNN models, (2) the feature fusion model can decode the imaging phenotypes representing NSCLC heterogeneity related to both EGFR mutation and patient NSCLC prognosis, and (3) high correlations exist between some deep image and radiomics features.

Structural-material-operational performance relationship for pool boiling on enhanced surfaces using deep neural network model

This article demonstrates the use of deep neural networks (NN) and deep reinforcement learning (deep-RL) for modeling and control of longitudinal heavy duty truck dynamics. Instead of explicit use of analytical model derived information or parameters about the truck, the deep NN model is fitted to data using a brief set of historical data collected from an arbitrary driving cycle. The deep model is used in this article to design a cruise controller for the truck using model-free deep-RL. The deep model and the control loop performances are demonstrated both using state-of-the-art commercial simulation software, and using a real-physical truck. Model and control performances are compared to classical physics-based modeling and control design approaches. The deep NN model is shown to capture latent nonlinear state dynamics and the deep-RL cruise controller is shown to achieve comparable results to a carefully designed and calibrated controller.

As training a high-performance deep neural network (DNN) model requires a large amount of data, powerful computing resources and expert knowledge, protecting well-trained DNN models from intellectual property (IP) infringement has raised serious concerns in recent years. Most existing methods using DNN watermarks to verify the ownership of the models after IP infringement occurs, which is reactive in the sense that they cannot prevent unauthorized users from using the model in the first place. Different from these methods, in this article, we propose an active authorization control and user’s fingerprint tracking method for the IP protection of DNN models by utilizing sample-specific backdoor attack. The proposed method inversely and multiplely exploits sample-specific trigger as the key to implement authorization control for DNN model, in which the generated triggers are imperceptible and sample-specific for clean images. Specifically, a U-Net model is used to generate backdoor instances. Then, the target model is trained on the clean images and backdoor instances, which are inversely labeled as wrong classes and correct classes, respectively. Only authorized users can use the target model normally by pre-processing the clean images through the U-Net model. Moreover, the images processed by the U-Net model will contain unique fingerprint that can be extracted to verify and track the corresponding user’s identity. This article is the first work that utilizes the sample-specific backdoor attack to implement active authorization control and user’s fingerprint management for DNN model under black-box scenarios. Extensive experimental results on ImageNet dataset and YouTube Aligned Face dataset demonstrate that the proposed method is effective in protecting the DNN model from unauthorized usage. Specifically, the protected model has a low inference accuracy (1.00%) for unauthorized users, while maintaining a normal inference accuracy (97.67%) for authorized users. Besides, the proposed method can achieve 100% fingerprint tracking success rates on both the ImageNet and YouTube Aligned Face datasets. Moreover, it is demonstrated that the proposed method is robust against fine-tuning attack, pruning attack, pruning attack with retraining, reverse-engineering attack, adaptive attack, and JPEG compression attack. The code is available at https://github.com/nuaaaisec/SSAT .

Deep learning technologies, which are the key components of state-of-the-art Artificial Intelligence (AI) services, have shown great success in providing human-level capabilities for a variety of tasks, such as visual analysis, speech recognition, and natural language processing and etc. Building a production-level deep learning model is a non-trivial task, which requires a large amount of training data, powerful computing resources, and human expertises. Therefore, illegitimate reproducing, distribution, and the derivation of proprietary deep learning models can lead to copyright infringement and economic harm to model creators. Therefore, it is essential to devise a technique to protect the intellectual property of deep learning models and enable external verification of the model ownership. In this paper, we generalize the digital watermarking'' concept from multimedia ownership verification to deep neural network (DNNs) models. We investigate three DNN-applicable watermark generation algorithms, propose a watermark implanting approach to infuse watermark into deep learning models, and design a remote verification mechanism to determine the model ownership. By extending the intrinsic generalization and memorization capabilities of deep neural networks, we enable the models to learn specially crafted watermarks at training and activate with pre-specified predictions when observing the watermark patterns at inference. We evaluate our approach with two image recognition benchmark datasets. Our framework accurately (100%) and quickly verifies the ownership of all the remotely deployed deep learning models without affecting the model accuracy for normal input data. In addition, the embedded watermarks in DNN models are robust and resilient to different counter-watermark mechanisms, such as fine-tuning, parameter pruning, and model inversion attacks.

Bone age is considered an indicator for the diagnosis of precocious or delayed puberty and a predictor of adult height. We aimed to evaluate the performance of a deep neural network model in assessing rapidly advancing bone age during puberty using elbow radiographs. In all, 4437 anteroposterior and lateral pairs of elbow radiographs were obtained from pubertal individuals from two institutions to implement and validate a deep neural network model. The reference standard bone age was established by five trained researchers using the Sauvegrain method, a scoring system based on the shapes of the lateral condyle, trochlea, olecranon apophysis, and proximal radial epiphysis. A test set (n = 141) was obtained from an external institution. The differences between the assessment of the model and that of reviewers were compared. The mean absolute difference (MAD) in bone age estimation between the model and reviewers was 0.15 years on internal validation. In the test set, the MAD between the model and the five experts ranged from 0.19 to 0.30 years. Compared with the reference standard, the MAD was 0.22 years. Interobserver agreement was excellent among reviewers (ICC: 0.99) and between the model and the reviewers (ICC: 0.98). In the subpart analysis, the olecranon apophysis exhibited the highest accuracy (74.5%), followed by the trochlea (73.7%), lateral condyle (73.7%), and radial epiphysis (63.1%). Assessment of rapidly advancing bone age during puberty on elbow radiographs using our deep neural network model was similar to that of experts. • Bone age during puberty is particularly important for patients with scoliosis or limb-length discrepancy to determine the phase of the disease, which influences the timing and method of surgery. • The commonly used hand radiographs-based methods have limitations in assessing bone age during puberty due to the less prominent morphological changes of the hand and wrist bones in this period. • A deep neural network model trained with elbow radiographs exhibited similar performance to human experts on estimating rapidly advancing bone age during puberty.

PurposeSleep apnea (SA) is highly prevalent, but under diagnosed due to inaccessibility of sleep testing. To address this issue, portable devices for home sleep testing have been developed to provide convenience with reasonable accuracy in diagnosing SA. The objective of this study was to test the validity a novel portable sleep apnea testing device, BresoDX1, in SA diagnosis, via recording of trachea-sternal motion, tracheal sound and oximetry.Patients and MethodsAdults with a suspected sleep disorder were recruited to undergo in-laboratory polysomnography (PSG) and a simultaneous BresoDX1 recording. Data from BresoDX1 were collected and features related to breathing sounds, body motions and oximetry were extracted. A deep neural network (DNN) model was trained with 61-second epochs of the extracted features to detect apneas and hypopneas from which an apnea-hypopnea index (AHI) was calculated. The AHI estimated by BresoDX1 (AHIbreso) was compared to the AHI determined from PSG (AHIPSG) and the sensitivity and specificity of SA diagnosis were assessed at an AHIPSG ≥ 15.ResultsTwo-hundred thirty-three participants (mean ± SD) 50 ± 16 years of age, with BMI of 29.8 ± 6.6 and AHI of 19.5 ± 22.7, were included. There was a strong relationship between AHIbreso and AHIPSG (r = 0.91, p < 0.001). SA detection for an AHIPSG ≥ 15 was highly sensitive (90.0%) and specific (85.9%).ConclusionWe conclude that the DNN model we developed via recording and analyses of trachea-sternal motion and sound along with oximetry provides an accurate estimate of the AHIPSG with high sensitivity and specificity. Therefore, BresoDX1 is a simple, convenient and accurate portable SA monitoring device that could be employed for home SA testing in the future.

COVID-19 is most commonly diagnosed using a testing kit but chest X-rays and computed tomography (CT) scan images have a potential role in COVID-19 diagnosis. Currently, CT diagnosis systems based on Artificial intelligence (AI) models have been used in some countries. Previous research studies used complex neural networks, which led to difficulty in network training and high computation rates. Hence, in this study, we developed the 6-layer Deep Neural Network (DNN) model for COVID-19 diagnosis based on CT scan images. The proposed DNN model is generated to improve accurate diagnostics for classifying sick and healthy persons. Also, other classification models, such as decision trees, random forests and standard neural networks, have been investigated. One of the main contributions of this study is the use of the global feature extractor operator for feature extraction from the images. Furthermore, the 10-fold cross-validation technique is utilized for partitioning the data into training, testing and validation. During the DNN training, the model is generated without dropping out of neurons in the layers. The experimental results of the lightweight DNN model demonstrated that this model has the best accuracy of 96.71% compared to the previous classification models for COVID-19 diagnosis.

This article proposes a deep neural network (DNN) model to predict the electric field induced by a transcranial magnetic stimulation (TMS) coil under high-amplitude and low-frequency current pulse conditions. The DNN model is comprised of an input layer with 6 neurons, three non-linear hidden layers with a total of 1088 neurons, and a linear single output layer. The model is developed in Google Colaboratory environment with TensorFlow framework using six features including coil turns of single wing, coil thickness, coil diameter, distance between two wings, distance between head and coil position, and angle between two wings of coil as the inputs and electric field as the output. The model performance is evaluated based on four verification statistic metrics such as coefficient of determination (R2), mean squared error (MSE), mean absolute error (MAE), and root mean squared error (RMSE) between the simulated and predicted values. The proposed model provides an adequate performance with R2 = 0.766, MSE = 0.184, MAE = 0.262, and RMSE = 0.429 in the testing stage. Therefore, the model can successfully predict the electric field in an assembly TMS coil without the aid of electromagnetic simulation software that suffers from an extensive computational cost.

Prediction of drilling induced delamination and circularity deviation in GFRP nanocomposites using deep neural network

Monitoring the quality of ground water in pipelines using deep neural network model

Deep neural network model with Bayesian hyperparameter optimization for prediction of NO[formula omitted] at transient conditions in a diesel engine

Estimating the relative importance of each sample in a training set has important practical and theoretical value, such as in importance sampling or curriculum learning. This kind of focus on individual samples invokes the concept of samplewise learnability: How easy is it to correctly learn each sample (cf. PAC learnability)? In this paper, we approach the sample-wise learnability problem within a deep learning context. We propose a measure of the learnability of a sample with a given deep neural network (DNN) model. The basic idea is to train the given model on the training set, and for each sample, aggregate the hits and misses over the entire training epochs. Our experiments show that the samplewise learnability measure collected this way is highly linearly correlated across different DNN models (ResNet-20, VGG-16, and MobileNet), suggesting that such a measure can provide deep general insights on the data’s properties. We expect our method to help develop better curricula for training, and help us better understand the data itself.