Deep Learning and Translation Technology

Online dynamic stability analysis plays a key role in modern power systems and is becoming even more vital with the penetration of Distributed Energy Resources (DERs). Identification of an accurate lower-order model for the ‘external system” makes it possible to carry out the stability analysis of a study system faster than the analysis for the original detailed system. However, the identified lower-order model becomes invalid when the operating state changes in the power system. ‘Black box’ representation of the ‘external system’ with the application of Deep Neural Networks (DNN) is widely discussed in the literature. In such equivalent models, the DNN response changes based on two aspects i.e. the operating point of the power system and the location/type of the fault. In this paper, a clustering algorithm is proposed to identify the clusters of the ‘external system’ models for different states of the power system, and a DNN is trained for each cluster. The clustering algorithm is based on the pre-fault steady-state power flow from the ‘external system’ to the ‘study system’, which is a reflection of changes in the system state. Mean Absolute Error (MAE) between responses of the actual fault and the predicted fault is used to evaluate the accuracy of the identified system. The proposed technique is easy to implement and requires a lesser number of DNN models compared to identifying an individual DNN model for each operating point to represent the ‘external system’.

The rise and fall of artificial neural networks is well documented in the scientific literature of both computer science and computational chemistry. Yet almost two decades later, we are now seeing a resurgence of interest in deep learning, a machine learning algorithm based on multilayer neural networks. Within the last few years, we have seen the transformative impact of deep learning in many domains, particularly in speech recognition and computer vision, to the extent that the majority of expert practitioners in those field are now regularly eschewing prior established models in favor of deep learning models. In this review, we provide an introductory overview into the theory of deep neural networks and their unique properties that distinguish them from traditional machine learning algorithms used in cheminformatics. By providing an overview of the variety of emerging applications of deep neural networks, we highlight its ubiquity and broad applicability to a wide range of challenges in the field, including quantitative structure activity relationship, virtual screening, protein structure prediction, quantum chemistry, materials design, and property prediction. In reviewing the performance of deep neural networks, we observed a consistent outperformance against non-neural networks state-of-the-art models across disparate research topics, and deep neural network-based models often exceeded the "glass ceiling" expectations of their respective tasks. Coupled with the maturity of GPU-accelerated computing for training deep neural networks and the exponential growth of chemical data on which to train these networks on, we anticipate that deep learning algorithms will be a valuable tool for computational chemistry. © 2017 Wiley Periodicals, Inc.

Application of deep neural networks for inferring pressure in polymeric acoustic transponders/sensors

Application of deep neural network and gamma-ray scattering in eccentric scale calculation regardless of the fluids volume fraction inside a pipeline

With the vigorous development of MOOC open online courses, low completion rate of courses has become an important side effect factor which is affecting the promotion and application of MOOC courses in worldwide. Through analysis of edX open data sets, it is found that loss of learners is one of the factors which are leading to low completion rate of MOOC courses, and also there is a close correlation between learning behavior and final scores with loss of learners. Based on this challenge, some research results show that low completion rate of MOOC courses can be greatly improved by predicting the relationship between learning behavior and scores. This article focuses on application of Deep Neural Network (DNN) in prediction and analysis of MOOC learners' learning behavior. First, data analysis of course performance and learning behavior are discussed, then prediction model based on DNN is given for learning behavior and final scores. Second, experiment is done for DNN model, the results show that DNN can be used for analysis and prediction of complex correlation between learning behavior and final scores, thus which can realize more accurate prediction, reduce loss of learner, and carry out individualized teaching intervention to potential learners.

Recently, data-driven approaches motivated by modern deep learning have been applied to optical communications in place of traditional model-based counterparts. The application of deep neural networks (DNN) allows flexible statistical analysis of complicated fiber-optic systems without relying on any specific physical models. Due to the inherent nonlinearity in DNN, various equalizers based on DNN have shown significant potential to mitigate fiber nonlinearity. In this paper, we propose turbo equalization (TEQ) based on DNN as a new alternative framework to deal with nonlinear fiber impairments. The proposed DNN-TEQ is constructed with nested deep residual networks (ResNet) to train extrinsic likelihood given soft-information feedback from channel decoding. Through extrinsic information transfer (EXIT) analysis, we verify that our DNN-TEQ can accelerate decoding convergence to achieve a significant gain in achievable throughput by 0.61 b/s/Hz. We also demonstrate that optimizing irregular low-density parity-check (LDPC) codes based on the EXIT chart of the DNN-TEQ can improve achievable rates by up to 0.12 b/s/Hz.

Currently, 3D face modeling has been more and more widely used in medical, animation, games, and other fields. With the application of deep neural network, 3D face modeling method based on deep learning is the main research direction at present. However, the accuracy of the 3D face reconstruction model is generally insufficient. To solve this problem, an improved algorithm model based on deep residual network is proposed in this paper. A new convolutional module of Squeeze-and-Excitation is introduced to increase the channel dependence of the entire model, and then Blendshape is combined to drive the entire face data. The normalization error of the new improved neural network algorithm is only 3.12% compared with other traditional algorithm models. The loss function was reduced by 56.72%, 48.95%, and 41.86%, respectively. Compared with the traditional algorithm, the improved algorithm has higher precision and more perfect expression driving ability. This study contributes to improving the accuracy of the whole 3D face reconstruction technology.

The objective of this paper is 2-fold. First, it develops a prediction system to help the credit card issuer model the credit card delinquency risk. Second, it seeks to explore the potential of deep learning (also called deep neural network), an emerging artificial intelligence technology, in credit risk domain. With a real-life credit card data linked to 711,397 credit card holders from a large bank in Brazil, this study develops a deep neural network to evaluate the risk of credit card delinquency based on the client’s personal characteristics and the spending behaviors. Compared to machine learning algorithms of logistic regression, naive Bayes, traditional artificial neural network, and decision tree, deep neural network has a better overall predictive performance with the highest F scores and AUC. The successful application of deep learning implies that artificial intelligence has great potential to support and automate credit risk assessment for financial institutions and credit bureaus.

Sedimentary basins, integral to Earth's geological history and energy resource exploration, undergo complex changes driven by sedimentation, subsidence and geological processes. Gravity anomaly inversion is a crucial technique offering insights into subsurface structures and density variations. Our study addresses the challenge of complex subsurface structure assessment by leveraging deep neural networks to invert observed gravity anomalies. Optimization approaches traditionally incorporate known density distributions obtained from borehole data or geological logging for inverting basement depth in sedimentary basins using observed gravity anomalies. Our study explores the application of deep neural networks in accurate architectural assessment of sedimentary basins and demonstrates their significance in mineral and hydrocarbon exploration. Recent years have witnessed a surge in the use of machine learning in geophysics, with deep learning models playing a pivotal role. Integrating deep neural networks, such as the feedforward neural networks, has revolutionized subsurface density distribution and basement depth estimation. This study introduces a deep neural network specifically tailored for inverting observed gravity anomalies to estimate two‐dimensional basement relief topographies in sedimentary basins. To enhance computational efficiency, a one‐dimensional discrete cosine transform based discretization approach is employed. Synthetic data, generated using non‐Gaussian fractals, compensates for the scarcity of true datasets for training the deep neural network model. The algorithm's robustness is validated through noise introduction with comparisons against an efficient and traditional global optimization‐based approach. Gravity anomalies of real sedimentary basins further validate the algorithm's efficacy, establishing it as a promising methodology for accurate and efficient subsurface imaging in geological exploration.

This essay discusses the important role of deep learning technology in optimizing the mobile visual search function of digital library. On this basis, it analyzes the necessity and feasibility of constructing mobile visual search mechanism based on deep learning technology, and expounds the application of deep neural network to construct mobile visual search. The main content of the visual search mechanism, including mobile visual big data input layer, mobile visual resource organization layer, deep neural network analysis layer, and mobile visual service interaction layer, etc., are designed to enhance the value of mobile visual search in a big data environment and promote big data The realization of personalized intelligent services of the Times Digital Library.

Short-term power load prediction is not only a critical part of power system dispatching but also an essential task for power marketing, grid planning, and other management departments; deep learning is an artificial intelligence method that has gained extensive attention in recent years; this paper selected three models with the most typical signs of deep learning recurrent neural networks and studied their model performance for short-term power load predictions, including power load data preprocessing, feature selection of prediction models, determination of model parameters, and comparison of prediction characteristics between shallow and deep networks, to explore and prove the applicability of deep learning neural networks in short-term power load predictions, ultimately improving the accuracy of short-term load predictions.KeywordsPower loadDeep learningPrediction

This thesis discusses the application of deep neural network in TBM parameters prediction and tunnel inspection. Three different of neural network models with different structures are established and optimized according to different application scenarios. The test results show that these models are feasible.

With the widespread applications of Deep Neural Networks (DNNs), the safety of DNNs has become a significant issue. The vulnerability of the neural networks against adversarial examples deepens concerns about the safety of DNNs applications. This paper proposed a novel defence method to improve the adversarial robustness of DNN classifiers without using adversarial training. This method introduces two new loss functions. First, a zero-cross-entropy loss is used to punish overconfidence and find the appropriate confidence for different instances. Second, a logit balancing loss is proposed to protect DNNs from non-targeted attacks by regularising incorrect classes’ logits distribution. This method achieved competitive adversarial robustness compared to advanced adversarial training methods. Meanwhile, a novel robustness diagram is proposed to analyse, interpret and visualise the robustness of DNN classifiers against adversarial attacks. Furthermore, a Log-Softmax-pattern-based adversarial attack detection method is proposed. This detection method can distinguish clean inputs and multiple adversarial attacks via one multi-classification MLP. In particular, it is state-of-the-art in identifying white-box gradient-based attacks; it achieved at least 95.5% accuracy for classifying four white-box gradient-based attacks with maximum 0.1% false positive ratio.

This article considers the main problems that are currently identified in the Russian Federation during the implementation of the project “Digital agriculture”. There is a selection of development trends of modern agriculture in the Russian Federation, where such digital technologies as big data, the Internet of Things, robotics, artificial intelligence are implemented. The authors have analyzed current agricultural research areas that conduct studies and implement various methods using deep machine learning and computer vision technologies. Attention is focused on the main tasks that, according to the authors, can solve various problems by implementing computer vision technology in crop production. Conclusions are also made about the representation and implementation of this technology in animal husbandry and fish farming. The team of authors presents a developed device for ultrasonic repelling of synanthropic mammals, describing the possibility of detecting a synanthropic organism, and shares research on the influence of ultrasonic signals on the behavior of mink. The article defines further areas of the practical application of deep learning neural networks in fish farming to solve applied problems that can be solved solely with the usage of computer vision technology.KeywordsComputer visionMovementAquaculture netImage processingColor space conversionActive contourUltrasoundUltrasound deviceMink

Application of Deep Learning Convolutional Neural Networks for Internal Tablet Defect Detection: High Accuracy, Throughput, and Adaptability