Deep Clustering Efficient Learning Network for Motion Recognition Based on Self-Attention Mechanism

Deep learning (also known as deep structured learning, hierarchical learning, or deep machine learning) is a branch of machine learning based on a set of algorithms that attempt to model high-level abstractions in data by using a deep graph with multiple processing layers, composed of multiple linear and nonlinear transformations. Deep learning has been characterized as a class of machine learning algorithms with the following characteristics [257]: • They use a cascade of many layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input. The algorithms may be supervised or unsupervised and applications include pattern analysis (unsupervised) and classification (supervised). • They are based on the (unsupervised) learning of multiple levels of features or representations of the data. Higher-level features are derived from lower-level features to form a hierarchical representation. • They are part of the broader machine learning field of learning representations of data. • They learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts. These definitions have in common: multiple layers of nonlinear processing units and the supervised or unsupervised learning of feature representations in each layer, with the layers forming a hierarchy from low-level to high-level features. Various deep learning architectures such as deep neural networks, convolutional deep neural networks, deep belief networks (DBN), and recurrent neural networks have been applied to fields like computer vision, automatic speech recognition, natural language processing, audio recognition, and bioinformatics where they have been shown to produce state-of-the-art results on various tasks. In this chapter we start in Section 7.1 with an introduction, giving a brief history of this field, the relevant literature, and its applications. Then we study some basic concepts of deep learning such as convolutional neural networks, recurrent neural networks, backpropagation algorithm, restricted Boltzmann machines, and deep learning networks in Section 7.2. Then we illustrate three examples for Apache Spark implementation for mobile big data (MBD), user moving pattern extraction, and combination with nonparametric Bayesian learning, respectively, in Sections 7.3 through 7.5. Finally, we have summary in Section 7.6.

Short-term traffic flow prediction (STFP) is one of the key technologies in Intelligence Transportation System (ITS). With the development of artificial intelligence technology, deep learning has been employed to STFP and certain achievements have been obtained. However, further improvement of STFP accuracy is constrained by the presence of noise, modal aliasing in the modal components and insufficient feature extraction of neural networks. Therefore, to more accurately capture the changing trend of traffic flow in different time periods, and increase the reliability and interpretability of the prediction models, improved variational mode decomposition (IVMD) and self-attention mechanism (SAM) based hybrid convolutional neural network (CNN) and long short term memory network (LSTM) are proposed for STFP in this study, benefited from the modal decomposition of IVMD and redistribution of the neural weights in CNN-LSTM networks by SAM, the proposed IVMD-CNN-LSTM-SAM effectively suppresses the influence of randomness and volatility of traffic flow, and accurately predict the short-term lane occupancy in the designated area. Furthermore, this study analyses the mechanism of SAM and IVMD in STFP, and proves the superiority of IVMD and SAM in signal decomposition with physical significance and weight allocation respectively. Therefore, the interpretability of the proposed neural network model is significantly improved. Eleven competitive neural networks forecasting methods are used as benchmarks and numerical studies based on actual traffic flow validate the accuracy and stability of the proposed IVMD-CNN-LSTM-SAM. Mean absolute percentage error and goodness of fit of the proposed model are 0.81% and 0.9968, respectively.

Accurate blood glucose (BG) prediction is necessary for daily glucose management of diabetes therapy. As glucose dynamics are often affected by various factors, such as diet, physical exercise, and insulin injection, it is difficult to consider all the relevant information and make a balance between the high-dimensional inputs and learning efficiency for a deep learning network. In this work, a novel multivariate predictor with a multi-scale long short-term memory (MS-LSTM) network was developed to automatically characterize the high-dimensional temporal dynamics and extract the features of blood glucose fluctuation and temporal trends sufficiently. Meanwhile, a multi-lag structure is designed for multiple variables, which can extract the dependence between different variables and blood glucose fluctuations more effectively. Furthermore, long-term sparse information was encoded and compressed to improve the learning efficiency of this deep learning network. The predictive capability of the proposed method was illustrated through 30-min and 60-min ahead glucose prediction in the OhioT1DM-2 Dataset. The root means square error (RMSE) values of 30-min and 60-min ahead predictions were 19.048 and 32.029, respectively, and the mean absolute error (MAE) values of 30-min and 60-min ahead predictions were 13.503 and 23.833. The results demonstrate the efficiency and prediction accuracy of the offline deep learning network, especially in the case of high-dimensional variables availability.

In recent years, gesture recognition and speech recognition, as important input methods in Human–Computer Interaction (HCI), have been widely used in the field of virtual reality. In particular, with the rapid development of deep learning, artificial intelligence, and other computer technologies, gesture recognition and speech recognition have achieved breakthrough research progress. The search platform used in this work is mainly the Google Academic and literature database Web of Science. According to the keywords related to HCI and deep learning, such as “intelligent HCI”, “speech recognition”, “gesture recognition”, and “natural language processing”, nearly 1000 studies were selected. Then, nearly 500 studies of research methods were selected and 100 studies were finally selected as the research content of this work after five years (2019–2022) of year screening. First, the current situation of the HCI intelligent system is analyzed, the realization of gesture interaction and voice interaction in HCI is summarized, and the advantages brought by deep learning are selected for research. Then, the core concepts of gesture interaction are introduced and the progress of gesture recognition and speech recognition interaction is analyzed. Furthermore, the representative applications of gesture recognition and speech recognition interaction are described. Finally, the current HCI in the direction of natural language processing is investigated. The results show that the combination of intelligent HCI and deep learning is deeply applied in gesture recognition, speech recognition, emotion recognition, and intelligent robot direction. A wide variety of recognition methods were proposed in related research fields and verified by experiments. Compared with interactive methods without deep learning, high recognition accuracy was achieved. In Human–Machine Interfaces (HMIs) with voice support, context plays an important role in improving user interfaces. Whether it is voice search, mobile communication, or children’s speech recognition, HCI combined with deep learning can maintain better robustness. The combination of convolutional neural networks and long short-term memory networks can greatly improve the accuracy and precision of action recognition. Therefore, in the future, the application field of HCI will involve more industries and greater prospects are expected.

Deep clustering was applied to unlabeled, automatically detected signals in a coral reef soundscape to distinguish fish pulse calls from segments of whale song. Deep embedded clustering (DEC) learned latent features of the signals and formed clusters using fixed-length power spectrograms of the signals. Handpicked spectral and temporal features were also extracted and clustered with Gaussian mixture models (GMM) and conventional clustering. DEC, GMM, and conventional clustering were tested on simulated datasets of fish pulse calls and whale song units with randomized bandwidth, duration, and SNR. Both GMM and DEC achieved high accuracy and identified clusters with fish calls, whale song units, and simultaneous fish calls and whale song units. Conventional clustering methods K-means and hierarchical agglomerative clustering had low accuracy in scenarios with unequally sized clusters or multiple signals. Experimentally detected fish pulse calls and whale song units recorded near Hawaii in February–March 2020 were clustered with DEC, GMM, and conventional clustering. DEC demonstrated the highest accuracy on a small, manually labeled dataset and successfully separated clusters of fish calls and whale song units. GMM achieved high recall for detecting whale song units but accuracy. Both GMM and DEC overpredicted the number of whale song unit signals.

Human motion behavior recognition (HMBR) is a critical research area in computer vision, enabling automated understanding of human activities through deep learning models. This field has witnessed rapid advancements due to the growing availability of large-scale motion datasets and computational improvements in deep learning architectures. Applications range from healthcare monitoring and security surveillance to sports analytics and human-computer interaction (HCI). Traditional handcrafted feature extraction techniques have been largely replaced by deep learning models, including convolutional neural networks (CNNs), recurrent neural networks (RNNs), long short-term memory networks (LSTMs), and transformer-based architectures. This paper presents a comprehensive study on real-time HMBR using deep learning, covering data acquisition, preprocessing, model architectures, optimization techniques, and real-time deployment strategies. Additionally, challenges such as occlusion, noise, computational efficiency, and ethical concerns are discussed, along with future research directions in self-supervised learning, multimodal data fusion, and scalable real-world deployment.

Raman spectroscopy has attracted much attention due to its wide applications in drug detection and many other fields. However, Raman spectra often contain background noise, which poses significant challenges for subsequent analysis and processing. Although various methods for removing background noise have been proposed and have improved analysis accuracy to some extent, these mathematical model-based methods often rely on parameter adjustments based on spectral data to achieve the desired de-noising effect. The introduction of deep learning technology has provided new ideas to solve this problem, breaking through the limitations of traditional methods in parameter dependency. Different deep learning structures exhibit unique advantages when processing different types of data. In this study, we propose a static dropout triangular deep convolutional network (SD-TDCN). This deep learning network can maintain superior performance while significantly reducing the size of model parameters by statically discarding some convolutional blocks in the deep learning network. In addition, this deep learning network also lays an experimental foundation for the subsequent development of deep learning structures with adaptive dropout mechanisms.

Emotional design is an important development trend of interaction design. Emotional design in products plays a key role in enhancing user experience and inducing user emotional resonance. In recent years, based on the user's emotional experience, the design concept of strengthening product emotional design has become a new direction for most designers to improve their design thinking. In the emotional interaction design, the machine needs to capture the user's key information in real time, recognize the user's emotional state, and use a variety of clues to finally determine the appropriate user model. Based on this background, this research uses a deep learning mechanism for more accurate and effective emotion recognition, thereby optimizing the design of the interactive system and improving the user experience. First of all, this research discusses how to use user characteristics such as speech, facial expression, video, heartbeat, etc., to make machines more accurately recognize human emotions. Through the analysis of various characteristics, the speech is selected as the experimental material. Second, a speech-based emotion recognition method is proposed. The mel-Frequency cepstral coefficient (MFCC) of the speech signal is used as the input of the improved long and short-term memory network (ILSTM). To ensure the integrity of the information and the accuracy of the output at the next moment, ILSTM makes peephole connections in the forget gate and input gate of LSTM, and adds the unit state as input data to the threshold layer. The emotional features obtained by ILSTM are input into the attention layer, and the self-attention mechanism is used to calculate the weight of each frame of speech signal. The speech features with higher weights are used to distinguish different emotions and complete the emotion recognition of the speech signal. Experiments on the EMO-DB and CASIA datasets verify the effectiveness of the model for emotion recognition. Finally, the feasibility of emotional interaction system design is discussed.

RETRACTED: Deep learning network (DL-Net) based classification and segmentation of multi-class retinal diseases using OCT scans

Deep learning neural network approach to thermal-wave imaging of damage in solids with application to diffusivity measurements of a green (unsintered) metal powder compact slab

Detecting subtle signals from small earthquakes triggered by transient stresses from the surface waves of large magnitude earthquakes can contribute to a more general understanding of how earthquakes nucleate and interact with each other. However, searching for signals from such small earthquakes in thousands of seismograms is overwhelming, and discriminating them from a miscellany of noise is challenging. Here, we explore how we can automate the detection of such dynamically triggered earthquakes using a simple, diagnostic signal-to-noise ratio (SNR) threshold as well as a convolutional deep metric learning network. Our analysis shows that the deep learning network was more reliable at detecting small earthquakes than the SNR method.

Modern industrial equipment plays a vital role in the operation of large industrial systems. Accurate prediction of its remaining useful life will greatly reduce the possibility of unsafe accidents. The internal structure of modern industrial equipment is very complex, and a variety of state monitoring data affect the remaining useful life of the equipment, and the mutual influence between different monitoring data has greatly increased the difficulty of remaining useful life prediction. In this paper, the long short-term memory network in deep learning is used to solve this problem. The long short-term memory network has many advantages in time series prediction. The remaining useful life prediction model of industrial equipment based on long short-term memory network and multivariable monitoring data is established, and aiming at the characteristics of multivariable monitoring data, Mini-batch Gradient Descent algorithm (MBGD) is adopted to train the network. Finally, the engine monitoring data set provided by the NASA prediction center is used to verify the algorithm. The data set is divided into training set and test set, the training set is put into the long short-term memory network to get the prediction model, and then the remaining useful life prediction is carried out by the test set. The prediction accuracy and generalization ability of the algorithm are verified by predicting the remaining useful life of three different turbofan engines.

Deep learning is a recently developed feature representation technique for data with complicated structures, which has great potential for soft sensing of industrial processes. However, most deep networks mainly focus on hierarchical feature learning for the raw observed input data. For soft sensor applications, it is important to reduce irrelevant information and extract quality-relevant features from the raw input data for quality prediction. To deal with this problem, a novel deep learning network is proposed for quality-relevant feature representation in this article, which is based on stacked quality-driven autoencoder (SQAE). First, a quality-driven autoencoder (QAE) is designed by exploiting the quality data to guide feature extraction with the constraint that the potential features should largely reconstruct the input layer data and the quality data at the output layer. In this way, quality-relevant features can be captured by QAE. Then, by stacking multiple QAEs to construct the deep SQAE network, SQAE can gradually reduce irrelevant features and learn hierarchical quality-relevant features. Finally, the high-level quality-relevant features can be directly applied for soft sensing of the quality variables. The effectiveness and flexibility of the proposed deep learning model are validated on an industrial debutanizer column process.

A dual-path model merging CNN and RNN with attention mechanism for crop classification

To decrease the impact of Partially Observable MDP on deep reinforcement learning performance of intersection signal control, A deep reinforcement learning is proposed in this paper with utilizing the real-time GPS data as well as learning the control of the traffic lights in single intersection. We integrate deep reinforcement learning network (DRQN) with recurrent neural network (RNN) and apply deep network, experience pool and greedy strategy in deep reinforcement learning strategy. It solves the problem of overestimation of target Q value and insufficient long-term experience learning in the standard reinforcement learning of traffic signal control. The comparison of performance was made between the proposed method and standard Deep Q-Network (DQN) on the partial observation of traffic situations. The experimental results show that both DQN and DRQN methods can adjust their traffic signal timing control strategies according to the specific traffic conditions as well as calculating a lower average delay time of vehicle than that of fixed-time control. Besides, the simulation effect of DRQN learning method is better than that of DQN learning method in different probe vehicle proportion environment.