Analysis of Application Examples of Differential Privacy in Deep Learning

This review paper examines the current state of lung disease diagnosis based on deep learning (DL) methods. Lung diseases, such as Pneumonia, TB, Covid-19, and lung cancer, are significant causes of morbidity and mortality worldwide. Accurate and timely diagnosis of these diseases is essential for effective treatment and improved patient outcomes. DL methods, which utilize artificial neural networks to extract features from medical images automatically, have shown great promise in improving the accuracy and efficiency of lung disease diagnosis. This review discusses the various DL methods that have been developed for lung disease diagnosis, including convolutional neural networks (CNNs), deep neural networks (DNNs), and generative adversarial networks (GANs). The advantages and limitations of each method are discussed, along with the types of medical imaging techniques used, such as X-ray and computed tomography (CT). In addition, the review discusses the most commonly used performance metrics for evaluating the performance of DL for lung disease diagnosis: the area under the curve (AUC), sensitivity, specificity, F1-score, accuracy, precision, and the receiver operator characteristic curve (ROC). Moreover, the challenges and limitations of using DL for lung disease diagnosis, including the limited availability of annotated data, the variability in imaging techniques and disease presentation, and the interpretability and generalizability of DL models, are highlighted in this paper. Furthermore, strategies to overcome these challenges, such as transfer learning, data augmentation, and explainable AI, are also discussed. The review concludes with a call for further research to address the remaining challenges and realize DL's full potential for improving lung disease diagnosis and treatment.

Deep learning algorithms can be used to design systems that report data on patients and deliver warnings to medical applications or electronic health information if there are changes in the patient's health. These systems could be created using deep Learning. This helps verify that patients get the proper effective care at the proper time for each specific patient. A healthcare decision support system was presented using the Internet of Things and deep learning methods. In the proposed system, we examined the capability of integrating deep learning technology into automatic diagnosis and IoT capabilities for faster message exchange over the Internet. We have selected the suitable Neural Network structure (number of best-hidden layers and activation function classes) to construct the e-health system. In addition, the e-health system relied on data from doctors to understand the Neural Network. In the validation method, the total evaluation of the proposed healthcare system for diagnostics provides dependability under various patient conditions. Based on evaluation and simulation findings, a dual hidden layer of feed-forward NN and its neurons store the tanh function more effectively than other NN. To overcome challenges, this study will integrate artificial intelligence with IoT. This study aims to determine the NN's optimal layer counts and activation function variations.

Excessive withdrawal of groundwater for agricultural irrigation can cause seawater intrusion into coastal aquifers. Such a case will in turn results in deterioration of irrigation water quality. Determination of irrigation water quality with traditional methods is a time-consuming and costly process. However, machine learning algorithms can be useful tools for modeling and estimating groundwater quality used for irrigation water purposes. In this study, TDS, PS, SAR, and Cl parameters of groundwater were estimated with models based on EC and pH variables. For this purpose, prediction performances of two different deep learning methods (convolutional neural network (CNN) and deep neural network (DNN)) and two different classical machine learning (Random Forest (RF) and extreme gradient boosting (XGBoost)) methods were compared. In addition, predictive uncertainty of the models was determined by quantile regression (QR) analysis. Performance criteria and results of uncertainty analysis revealed that CNN (in testing phase, NSE = 0.95 for TDS, NSE = 0.96 for PS, NSE = 0.67 for SAR and NSE = 0.93 for CI) and DNN (in testing phase, NSE = 0.91 for TDS, NSE = 0.91 for PS, NSE = 0.57 for SAR and NSE = 0.94 for Cl) models had quite a close performance in estimation of TDS, PS, SAR, and Cl parameters and higher than the other two classical machine learning methods. As a result, the CNN model can be considered the best performing model in estimating all quality parameters due to the highest NSE and lowest RMSE values. In addition, the Taylor diagram showed that the values estimated using the CNN model had the highest correlation with the measured data. It was determined that the model with the lowest uncertainty based on the PICP statistics was DNN, followed by the CNN model. However, the CNN model has predicted outliers more accurately. Present findings proved that deep learning models could offer efficient tools for predicting irrigation water quality parameters.

Learning ability is the basic characteristic of human intelligence. The July 1, 2005 issue of Science published a list of 125 important questions in science. Among them, the question 94 “What are the limits of learning by machines?”. The annotation “Computers can already beat the world’s best chess players, and they have a wealth of information on the Web to draw on. But abstract reasoning is still beyond any machine”. In recent artificial intelligence has made great progresses. In 1997, the rise of the man-machine war, IBM Supercomputer Deep Blue defeated the chess master Garry Kasparov. On February 14, 2011, IBM’s Watson supercomputer won a practice round against Jeopardy champions Ken Jennings and Brad Rutter. In March 2016, Google DeepMind’s AlphaGo sealed a 4-1 victory over a South Korean Go grandmaster Lee Se-dol. This paper focuses on the machine learning methods of AlphaGo, including reinforcement learning, deep learning, deep reinforcement learning, analysis of the existing problems and the latest research progress. Deep reinforcement learning is the combination of deep learning and reinforcement learning, which can realize the learning algorithm from the perception to action. Simply said, this is the same as human behavior, input sensing information such as vision, and then, direct output action through the deep neural network. Deep reinforcement learning has the potential to learn a variety of skills for the robot to achieve full autonomy. Even though reinforcement learning is practiced successfully, but feature states need to manually set, for complex scene is a difficult thing, especially easy to cause the dimension disaster, and expression is not good. In 2010, Sascha Lange and Martin Riedmiller proposed deep auto-encoder neural networks in reinforcement learning to extract feature, which is used to control the visual correlation. In 2013, DeepMind proposed deep Q-network (DQN) in NIPS 2013, using convolution neural network to extract features, and then applied in reinforcement learning. They continue to improve and published an improved version of DQN on Nature in 2015, which has aroused widespread concern. In order to break through the limits of learning by machines, cognitive machine learning is proposed, which is the combination of machine learning and brain cognition, so that the machine intelligence is constantly evolving, and gradually reaches the human level of artificial intelligence. A cognitive model entitled Consciousness And Memory (CAM) is proposed by author, which consists of memory, consciousness, high-level cognitive functions, perception and motor. High-level cognitive functions of the brain include learning, language, thinking, decision making, emotion, and so on. Learning is a course to accept the stimulus through the nervous system and obtain new behavior, habits and accumulation experience. According to the current research progress of brain science and cognitive science, cognitive machine learning may be interested in learning emergence, procedural memory knowledge learning, learning evolution and so on. For intelligence, so-called evolution is refers to the learning of learning and the structure also follows the change. It is important to record the learning result by structure changing and improve the learning method.

1 - Congruence of deep learning in biomedical engineering: future prospects and challenges

AI-generated content (AIGC) in the context of dermoscopic image analysis describes the application of artificial intelligence (AI) approaches to produce synthetic images for training and enriching machine learning (ML) methods. In dermatology, where dermoscopic images are essential in skin lesion detection, AIGC helps overcome the challenges of inadequate datasets and class imbalances. By employing advanced generative complex systems like Generative Adversarial Networks (GANs), AIGC will simulate different dermoscopic conditions by generating realistic-view synthetic images. These AI-generated images help to enhance the training dataset, contributing to the ML models with many widespread and varied sets of instances. This aids in increasing the ability of the model to precisely predict and generalize while handling new, unnoticed dermoscopic images. Deep learning (DL) methods, specifically convolutional neural networks (CNNs), can provide a massive breakthrough in an extensive range of computer vision (CV) tasks of complex systems, predominantly by exploiting large-scale annotated datasets. This paper develops a GAN-based Synthetic Medical Image Augmentation for the imbalanced Dermoscopic Image Analysis (GANSMIA-CDIA) method. The GANSMIA-CDIA technique’s primary target is exploiting the GAN model for synthetic image generation to handle class imbalance data problems. In addition, the GANSMIA-CDIA technique diagnoses the melanoma using the optimal DL model. The GANSMIA-CDIA technique applies a contrast enhancement process for the noise eradication process. The GANSMIA-CDIA technique follows a feature fusion method comprising different DL methods such as MobileNetV2, AlexNet, ResNet50, and Inceptionv3 to learn feature patterns in the preprocessed images. Meanwhile, the Social Network Search (SNS) technique is utilized for the hyperparameter tuning process. Also, the bidirectional long short-term memory (BiLSTM) technique is implemented to detect and classify melanoma. A series of simulations were performed on the standard dermoscopic image dataset to evaluate the performance of the GANSMIA-CDIA technique. The experimental values indicate the excellence of the GANSMIA-CDIA technique over existing techniques.

Background Electrocardiographic predictors of atrial fibrillation (AF) from a non-AF ECG–such as p wave abnormalities and supraventricular ectopy–have been extensively documented. However, risk prediction tools for AF utilize little if any of the wealth of information available from the ECG. Better AF prediction from the ECG may improve efficiency of screening and performance of AF risk tools. Deep learning methods have the potential to extract an unlimited number of features from the ECG to improve prediction of AF. Purpose We hypothesize that a deep learning model can identify patterns predictive of AF during normal sinus rhythm. To test the hypothesis, we trained and tested a neural network to predict AF from normal sinus rhythm ambulatory ECG data. Methods We trained a deep convolutional neural network to detect features of AF that are present in single-lead ECGs with normal sinus rhythm, recorded using a Food and Drug Administration (FDA)-cleared, smartphone-enabled device. A cohort of 27,526 patients with at least 50 ECGs recorded between January 7, 2013, and September, 19, 2018, and the FDA-cleared automated findings of Normal and Atrial Fibrillation associated with those ECGs, were used for model development. Specifically, we trained the deep learning model on 1,984,581 Normal ECGs from 19,267 patients with 1) only Normal ECG recordings, or 2) at least 30% ECGs with AF. Of the 27,526 patients, an internal set of 8,259 patients with 841,776 Normal ECGs was saved for testing (validation). Results Among 8,259 patients in the test set, 3,467 patients had at least 30% of their ECGs with an automated finding of AF. When the deep learning model was run on 841,776 Normal ECGs, it was able to predict whether the ECG was from a patient with no AF or with 30% or more AF, with an area under the curve (AUC) of 0.80. Using an operating point with equal sensitivity and specificity, the model's sensitivity and specificity were 73.1%. Using an operating point with high specificity (90.0%), the model's sensitivity was 48.0%. When the model was applied to a randomly-selected, broader cohort of 15,000 patients (at least 50 ECGs recorded, any amount of AF), a positive, non-linear relationship between neural network output and AF burden per patient was observed (Figure). Model Output vs AF Burden Per Patient Conclusions A deep learning model was able to predict AF from ECGs in normal sinus rhythm that were recorded on a smartphone-enabled device. The use of deep learning, if prospectively validated, may facilitate AF screening in patients with paroxysmal disease or warn patients who are at high risk for developing AF. Acknowledgement/Funding AliveCor

Multiple Sclerosis (MS) is a chronic immune-mediated inflammatory disease (IMID) of the central nervous system (CNS). Early identification of MS, especially as a screening method for at-risk individuals, is crucial to delay disease progression and improve patient outcomes by preventing future irreversible neurologic damage. In this work, we utilize well-validated tracking scanning laser ophthalmoscope (TSLO) image to predict MS compared to the unaffected controls. While traditional Machine Learning (ML) methods, such as Logistic Regression (LR), have demonstrated a strong predictive power [Mauro F. Pinto et al., 2020] in disease identification, we propose the use of a novel DL based model. Though the use of Deep Neural Network (DNN), this model can have a much higher learning capacity to capture latent features embedded in the retinal images. We hypothesize that such latent information, often hidden in ML feature engineering processes, plays an important role for the prediction of disease and can be well represented by DL models. To establish a DL based model capable of learning latent image features to provide predictive power for the presence of MS. Utilize a deep convolutional neural network to extract the retinal coding and implement a recurrent neural network to learn the temporal correlations in video sequences. Our approaches were tested using a 250-subject MS/control database collected at the UCSF. Patients with Expanded Disability Status Scale (EDSS)< 4 are compared to healthy subjects. Both raw retinal images and the frequency and spatial patterns of the eye motion are combined to construct a hybrid image, denoted as "retinal coding", and directly fed to the DL model for training and testing. Preliminary results on predictive power were measured using Area-under-Curve (AUC) of the Receiver Operating Characteristics (ROC) curve, sensitivity, and specificity, as well as an F-1 score. We observe an AUC of 0.920, sensitivity of 0.90, specificity of 0.89 and F-1 score of 0.89 using the DL model to distinguish MS from controls, which outperforms the baseline LR model by 24%. This work can be considered as a proof-of-concept concerning the possibility of identifying MS disease using a DL based approach. The results demonstrate the possibility of predicting early-stage MS and understanding disease's dynamics. Such end-to-end model could be generalizable and trained on other disease states.

Automated image classification is an essential task of the computer vision field. The tagging of images into a set of predefined groups is referred to as image classification. The implementation of computer vision to automate image classification would be beneficial because manual image evaluation and identification can be time-consuming, particularly when there are many images of different classes. Deep learning approaches are proven to overperform existing machine learning techniques in many fields in recent years, and computer vision is one of the most notable examples. The very deep neural network (VDCNN) is a powerful deep learning model for image classification, and this paper examines it briefly using MNIST handwritten digit dataset. This dataset is used to prove the efficacy of very deep neural networks over other deep learning models. The proposed study aims to comprehend the very deep neural network architecture used to accomplish a handwritten digit recognition task. The feasibility of the proposed model is evaluated using mean accuracy, validation accuracy, and standard deviation. The study results of the very deep neural network model are compared to a convolutional neural network and convolutional neural network with batch normalization. According to the results of the comparison study, very deep neural networks achieve high accuracy of 99.1% for a handwritten dataset. The outcome of the proposed work is used to interpret how well a very deep neural network performs when compared to the other two models of deep neural networks. This proposed architecture may be used to automate the classification of handwritten digits dataset.

In a previous paper, we introduced a deep learning neural network that should be able to detect the existence of very shallow periodic planetary transits in the presence of red noise. The network in that feasibility study would not provide any further details about the detected transits. The current paper completes this missing part. We present a neural network that tags samples that were obtained during transits. This is essentially similar to the task of identifying the semantic context of each pixel in an image—an important task in computer vision, called “semantic segmentation,” which is often performed by deep neural networks. The neural network we present makes use of novel deep learning concepts such as U-Nets, Generative Adversarial Networks, and adversarial loss. The resulting segmentation should allow further studies of the light curves that are tagged as containing transits. This approach toward the detection and study of very shallow transits is bound to play a significant role in future space-based transit surveys such as PLATO, which are specifically aimed to detect those extremely difficult cases of long-period shallow transits. Our segmentation network also adds to the growing toolbox of deep learning approaches that are being increasingly used in the study of exoplanets; but, so far mainly for vetting transits, rather than their initial detection.

Deep learning-based land cover and land use (LCLU) classification systems are a significant aspiration for remote sensing communities. In nature, remote sensing images have various properties that need to be analyzed. Analyzing and interpreting image properties is difficult due to the nature of the image, the sensor technology’s capability, and other determinant variables such as seasons and weather conditions. The problem is essential for environmental monitoring, agricultural decision-making, and urban planning if it can be supported by deep learning systems. Therefore, deep learning approaches are proposed to quickly analyze and interpret the remote sensing image to classify the LCLU. The deep learning methods could be designed starting from scratch or using pre-trained networks. However, there are few comparisons of deep learning methods developed from scratch and trained on pre-trained networks. Thus, we proposed evaluating and comparing the deep learning models convolutional neural network feature extractor (CNN-FE) by developing it from scratch, transfer learning, and fine-tuning it for the LCLU classification system using remote sensed images. Using CNN-FE, TL, and fine-tuning deep learning models as examples, this paper compares and analyzes deep learning algorithms for remote sensed image classification. After developing and training each deep learning model on the UCM dataset, we evaluated and compared their performances using the performance measurement metrics accuracy, precision, recall, f1-score, and confusion matrix. The proposed deep learning algorithms can adapt and learn the features of the remote sensing images, and the TL and fine-tuning classification performances are significantly improved. As a result of the efficient time used for training the models, this paper discovered that the fine-tuned deep learning model achieved profound accuracy performance results in the UCM dataset.

In recent years, Deep Learning (DL), such as the algorithms of Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN) and Generative Adversarial Networks (GAN), has been widely studied and applied in various fields including agriculture. Researchers in the fields of agriculture often use software frameworks without sufficiently examining the ideas and mechanisms of a technique. This article provides a concise summary of major DL algorithms, including concepts, limitations, implementation, training processes, and example codes, to help researchers in agriculture to gain a holistic picture of major DL techniques quickly. Research on DL applications in agriculture is summarized and analyzed, and future opportunities are discussed in this paper, which is expected to help researchers in agriculture to better understand DL algorithms and learn major DL techniques quickly, and further to facilitate data analysis, enhance related research in agriculture, and thus promote DL applications effectively. Keywords: deep learning, smart agriculture, neural network, convolutional neural networks, recurrent neural networks, generative adversarial networks, artificial intelligence, image processing, pattern recognition DOI: 10.25165/j.ijabe.20181104.4475 Citation: Zhu N Y, Liu X, Liu Z Q, Hu K, Wang Y K, Tan J L, et al. Deep learning for smart agriculture: Concepts, tools, applications, and opportunities. Int J Agric & Biol Eng, 2018; 11(4): 32-44.

Cyber security in smart cities: A review of deep learning-based applications and case studies

In recent years, with the popularity of artificial intelligence (AI) applications, financial market forecasting based on deep learning models has gotten more attention in academia and industry. According to statistics, a long short-term memory network (LSTM) is the first choice for deep learning to deal with the financial time series predicting problems due to its internal memory that can process incoming input with the previous state. However, most of the research used the raw financial time series data composed of opening, closing, highest, lowest price, and transactional time as learning features to feed into models. This study proposed a novel approach focusing on appropriate structures that can organize the price activities as a bell shape curve and identify the greed and fear in the market with deep convolutional neural networks. In addition, this study also considered the influence of time causality on patterns. It is difficult to accurately catch the rapid changes in the market, especially the causal link between various patterns and trend reversal behavior while using only static features extracted by AI models. We designed disparate methods while generating images that could keep the time-variant features on structures and be extracted by convolutional neural networks. Each image was labeled as the upward trend to downward trend, downward trend to upward trend, and trend did not change according to reversals of overall price direction. Finally, to evaluate the availability of the trained model, two-stage experiments were carried out. The first stage of the experiment mainly evaluated the accuracy and profitability of trades following the models, and the second stage considered practical trading rules such as the stop-loss mechanism. The results of the first and second stages showed the proposed models had better profitability and extremely well-matched classification capabilities when compared with the state-of-the-art deep learning models.

The using of deep learning method belongs to the application and research of artificial intelligence technology in medical field for assisting medical image information processing. Due to the larger difference between the image underlying character features and high-level semantic concepts described, the existing image annotation algorithms perform not very ideal, therefore, the we propose an image annotation framework based on multimodule deep transfer learning method, aiming at the application of deep convolution neural network technology to optimize the neural network parameters, and improve the tagging accuracy in detail. The proposed multimodule deep learning annotation framework uses two stages to optimiz neural network parameters: (1) using deep neural network to optimize the single-mode condition parameters; (2) using the phase correlation, to realize the multi-mode state, the experiment of the optimal combination of public data sets shows that the scheme can effectively improve the performance of image annotation.