Temporal graph convolutional network soft sensor for molecular weight distribution prediction

Human skeleton sequences provide important information for human action recognition. Compared with video data, it has lower sensitivity to light and lower data redundancy. Many traditional skeleton-based methods generally believe that all joints in a skeleton sequence are of the same contribution for an action. This paper proposes a novel action recognition method based on an attention and temporal graph convolutional network (ATGCN). The network could automatically learn spatial and temporal features from skeleton data. The attention mechanism is applied to weight joints to obtain their contributions in an action. Experiments conducted NTU RGB+D and WorkoutUOW-18 datasets have demonstrated the effectiveness of the proposed method.

This monograph presents studies concerning the challenging topic of Human Action Recognition, which has recently become of increasing importance to those working in the field of Computer Vision. It contains an overview of the research literature on tennis movements recognition based on video, images, motion capture data, and data registered using various sensors. In this monograph, three novel methods of tennis movements recognition are presented in detail with success, achieving high performance of the proposed classifiers. They all utilize Graph Convolutional Neural networks (GCN) solutions. Two methods are also applied using attention modules which improve feature extraction and thus make the classification better. The Spatial- -Temporal Graph Convolutional Network, the Attention-Temporal Graph Convolutional Network and the Dual Attention Temporal Graph Convolutional Network are applied for recognition of the most frequently used tennis moves, such as: forehand, backhand, volley forehand, and volley backhand. Moreover, the forehand and backhand are further divided into two phases: 1) the preparation, starting from the player’s positioning until the moment just before the ball makes contact with the racket, 2) the hit together with the racket swinging until the move is finished. These separations allow detailed analysis. For the purpose of this study, a 3DTennisDS dataset was created that contains motion capture data of the forehand, backhand, volley forehand, and volley backhand. They were registered via the Vicon motion capture system. Three proposed neural networks methods were verified based on the gathered dataset. In this monograph, the interpretability aspect of GCN was also presented. This issue is important and was examined by presenting feature maps and heatmaps obtained after selected convolutional operations. These results showed how individual filters in GCNs extract features that are relevant for recognizing tennis movements.

Forced oscillation location based on temporal graph convolutional network

Traffic speed prediction is difficult because of the complicated dynamic spatiotemporal correlations. Recent studies in spatiotemporal models have achieved impressive outcomes for traffic speed prediction. But many studies use graphs in graph convolutional networks to learn spatial features that are often static. Additionally, effectively modeling long-range temporal features is crucial for prediction accuracy. In order to overcome these challenges, a Spatial–Temporal Adaptive Graph Convolutional Network with Transformer (ST_AGCNT) is designed in this paper. Specifically, an adaptive graph convolution network (AGCN) is designed to extract spatial dependency. An adaptive graph that fuses predefined matrices and learnable matrix is proposed to learn the correlations between nodes. The predefined matrices provide the model with richer prior information, while the learnable matrix can extract the dynamic nature of the nodes. And a temporal transformer (TT) is proposed to extract the long-range temporal dependency. In addition, to learn more information to achieve better results, different historical segments are modeled. Experiments conducted on a real-world traffic dataset confirm the effectiveness of the proposed model when compared to other baseline models. This model demonstrated excellent performance in prediction tasks across different time steps, effectively accomplishing traffic speed forecasting. It provides data support for improving traffic efficiency and reducing resource waste, contributing to the sustainable development of traffic management.

The main core purpose of artificial emotional intelligence is to recognize human emotions. Technologies such as facial, semantic, or brainwave recognition applications have been widely proposed. However, the abovementioned recognition techniques for emotional features require a large number of training samples to obtain high accuracy. Human behaviour pattern can be trained and recognized by the continuous movement of the Spatial Temporal Graph Convolution Network (ST-GCN). However, this technology does not distinguish between the speed of delicate emotions, and the speed of human behaviour and delicate changes of emotions cannot be effectively distinguished. This research paper proposes Spatial Temporal Variation Convolutional Network training for human emotion recognition, using skeleton detection technology to calculate the degree of skeleton point change between consecutive actions and using the nearest neighbour algorithm to classify speed levels and train the ST-GCN recognition model to obtain the emotional state. Application of the speed change recognition ability of the Spatial Temporal Variation Graph Convolution Network (STV-GCN) to artificial emotional intelligence calculation makes it possible to efficiently recognize the delicate actions of happy, sad, fear, and angry in human behaviour. The STV-GCN technology proposed in this paper is compared with ST-GCN and can effectively improve the recognition accuracy by more than 50%.

Spatial–Temporal Similarity Fusion Graph Adversarial Convolutional Networks for traffic flow forecasting

Temporal graph convolutional network for multi-agent reinforcement learning of action detection

Current forecasting methods for complex geographic scenes often fail to adequately account for both intrinsic factors and external environmental variables, which limits their predictive accuracy. This study proposes Scene-GCN, a Graph Convolutional Network (GCN)-based model that utilizes a spatio-temporal knowledge graph (ST-KG) to integrate static and dynamic environmental factors with the scene’s spatio-temporal characteristics to predict trends. First, variations at each monitoring target point are abstracted as geo-processes, and instantaneous monitoring values are represented as geographic states, forming a coupled “process-state” ST-KG model tailored for monitoring networks in complex geographic scenes. Environmental knowledge, both dynamic and static, is then embedded within the nodes of the ST-KG, capturing historical and real-time contextual influences through feature computation. Next, a temporal graph convolutional network (T-GCN) cell is developed to quantify the relationships between spatio-temporal features, environmental knowledge, and target predictions. Experimental evaluation on a real-world time-series dataset for monitoring surface deformation in a tailings dam shows that our method outperforms baseline models. Ablation studies further show that the integration of the ST-KG enhances forecasting performance, reducing root mean square error (RMSE) by 49.2% compared to a T-GCN model without ST-KG. Additionally, leveraging a graph neural network framework improves the model’s interpretability over traditional time-series forecasting methods.

Deep learning is an appropriate methodology for modeling complex industrial data in the field of soft sensors, owing to its powerful feature representation capability. Given the nonlinear and dynamic nature of the process industry, the key challenge for soft sensor technology is to effectively mine dynamic information from long sequences and accurately extract features of relevance to quality. A dual temporal attention mechanism-based convolutional long short-term memory network (DTA-ConvLSTM) under an encoder-decoder framework is proposed as a soft sensor model to acquire quality-relevant dynamic features from serial data. Considering different influences of process variables for prediction at multiple time steps and various locations, ConvLSTM and temporal self-attention mechanism are utilized as the encoder to adaptively fuse spatiotemporal features and capture long-term dynamic properties of process in order to capture the trends of industrial variables. Furthermore, a quality-driven temporal attention mechanism is employed throughout the decoding process to dynamically select relevant features to more accurately track quality changes. The encoder-decoder model meticulously analyses the interactions between process and quality variables by incorporating dual-sequence dynamic information to improve the prediction performance. The validity and superiority of the DTA-ConvLSTM model was validated on two industrial case studies of the debutanizer column and sulfur recovery unit. Compared to the traditional LSTM model, the proposed model demonstrated a substantial improvement with the accuracy R2 up to 97.3% and 94.9% and the root mean square error reducing to 0.122 and 0.022.

Accurate and reliable estimation of reference crop evapotranspiration (ET0) in the North Henan Plain is crucial for agricultural water resource management, production, and food supply in China. This study aims to evaluate the performance of deep learning (DL) methods in ET0 estimation and assess the applicability of the developed DL model beyond the training domain. This study utilized historical meteorological data from Zhengzhou City, northern Henan, spanning 2010–2024. Meteorological variables were selected through correlation analysis and maximum information coefficient (MIC). A novel DL model—the TCN-Attention model (TA)—was constructed by incorporating a self-attention mechanism into the temporal convolutional network (TCN) model. This model was compared with two classical DL models—Long Short-Term Memory (LSTM) and TCN. Results indicate: (1) Sunshine duration (n), relative humidity (RH), and maximum temperature (Tmax) are the three most significant features influencing summer maize evapotranspiration; (2) prediction accuracy under the same input scenarios: TA model > TCN model > LSTM model; (3) in scenarios where only temperature data is input, the TA model has the highest prediction accuracy, surpassing the H-S empirical method; and (4) for limited meteorological data, the combination of temperature and humidity was found to be most effective, showing good adaptability and accuracy at different time steps (hourly: R2 = 0.982; daily: R2 = 0.975; weekly: R2 = 0.928). This study highlights the potential of the TA model for estimating reference crop evapotranspiration in the northern Henan Plain, which may provide theoretical guidance for crop irrigation management under future climate change.

The accuracy of short-term electricity price forecasting has profound influence on the business decisions made by the participants in the electricity market. Thus, we propose a short-term electricity price combination prediction model based on Complete Ensemble Empirical Mode Decomposition(CEEMD) as well as Temporal Convolutional Attention-based Network(TCAN). First, we defined the correlations among the features according to the Pearson Correlation Analysis and selected the desired features for our model. We then defined the single prediction period to be 24 hours based on the Unit Root test. In addition, we decomposed and denoised the data based on CEEMD and built the attention mechanism into the temporal convolution network. Using the expansion cascade network to extract the relationship between the inputs, combined with the self-attention mechanism to extract the internal information and learn the position dependence, effectively improve the model training speed and prediction accuracy. In order to verify the validity of the model, the actual electricity price data of DK1 in the Nordic electricity market from April to May 2020 were forecasted. The results show that the proposed method can effectively improve the accuracy and reliability of electricity price forecasting, and can provide reliable decision-making basis.

Accurate load forecasting is essential for ensuring safe, stable, and economical operation of energy internet. Temporal convolutional networks (TCNs) have demonstrated superior performance, when compared to recurrent neural network models, since their introduction in electrical load forecasting. However, the current TCN‐based models are unable to obtain a large receptive field and strong long‐time feature extraction capability owing to the specific kernel size of the 1D convolution structure. This paper proposes a temporal inception convolutional network based on multi‐head attention (TICN‐Att) for ultra‐short‐term load prediction. By introducing an inception structure into the TCN, the proposed model can extract multi‐dimensional information from the input features, through the multiple hidden convolutional kernels of different scales, without stacking layers depth‐wise. Simultaneously, by introducing a multi‐head attention mechanism, the TICN‐Att model has a long time‐dependent extraction capability, similar to that of the long short‐term memory network models. The generalization and validity of the model are tested using the global energy forecasting competition (GEFCOM2014) dataset, electrical load data of a city in Jiangsu (China), and PJM power system dataset. The experimental results demonstrated that the proposed model has the best prediction effect, compared to the other state‐of‐the‐art models.

Due to the high uncertainties in temperature changes, traditional regression analysis and time series prediction methods fail to provide accurate temperature forecasts to reduce the impact of extreme weather on human society. Considering the spatiotemporal features of temperature changes, this paper proposes a variable weight combination model based on a temporal graph convolutional network (T-GCN), Luong attention network (LUA) and gated recurrent unit (GRU) network, which fully utilizes spatiotemporal information to predict future temperature changes more accurately. The model uses the T-GCN model to capture spatiotemporal features while introducing Luong attention to weight the inputs at different time steps to improve the prediction accuracy and further reduce the prediction error by fusing the outputs of the T-GCN-Luong attention and GRU models through the variable weight combination method. The results revealed that (1) the inclusion of spatial information significantly improved the effectiveness of the temperature predictions. (2) The Luong attention mechanism weights different time steps and improves the prediction accuracy of the T-GCN model. (3) The TGLAG combination model constructed via the variable weight method exhibited good predictive performance at 15 sites. Compared with that of the simple GRU model, the accuracy of the proposed model is improved by approximately 31.949% in terms of the root mean square error (RMSE) and 26.913% in terms of the mean absolute error (MAE). Compared with the second-best model, T-GCN-Luong attention, the TGLAG model yields a 5.946% lower RMSE and 9.535% lower MAE, which indicates that TGLAG has good application prospects in the field of temperature prediction.

With the continuous development of smart cities, intelligent transportation systems (ITSs) have ushered in many breakthroughs and upgrades. As a solid foundation for an ITS, traffic flow prediction effectively helps the city to better manage intricate traffic flow. However, existing traffic flow prediction methods such as temporal graph convolutional networks(T-GCNs) ignore the dissimilarities between lanes. Thus, they cannot provide more specific information regarding predictions such as dynamic changes in traffic flow direction and deeper lane relationships. With the upgrading of intersection sensors, more and more intersection lanes are equipped with intersection sensors to detect vehicle information all day long. These spatio-temporal data help researchers refine the focus of traffic prediction research down to the lane level. More accurate and detailed data mean that it is more difficult to mine the spatio-temporal correlations between data, and modeling heterogeneous data becomes more challenging. In order to deal with these problems, we propose a heterogeneous graph convolution model based on dynamic graph generation. The model consists of three components. The internal graph convolution network captures the real-time spatial dependency between lanes in terms of generated dynamic graphs. The external heterogeneous data fusion network comprehensively considers other parameters such as lane speed, lane occupancy, and weather conditions. The codec neural network utilizes a temporal attention mechanism to capture the deep temporal dependency. We test the performance of this model based on two real-world datasets, and extensive comparative experiments indicate that the proposed heterogeneous graph convolution model can improve the prediction accuracy.

Multi-channel speech enhancement aims at utilizing spatial relationships between signals captured from a microphone array along with temporal-spectral information efficiently to estimate the clean target. An emerging approach is to design deep learning-based end-to-end architectures. In this work, we provide a new way to process latent multi-channel representations. We introduce a novel end-to-end system called <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">temporal graph convolutional network</i> , which views the embedding space of multi-channel signals as a graph and leverages the power of graph neural networks (GNNs) to analyze spatial correlations as well as temporal-spectral information simultaneously. To be specific, graph convolutional networks (GCNs), a popular GNN variant, are integrated into a complex convolutional encoder-decoder structure to compute a complex ideal ratio mask. The estimated mask is subsequently multiplied with the reference microphone spectrogram to get enhanced speech. We demonstrate the superiority of our approach by comparing it to state-of-the-art methods on ConferencingSpeech 2021 Challenge data. Our results and analyses prove that GCN is a novel yet promising mechanism for speech enhancement systems, providing an interesting alternative for recent deep learning-based approaches and inspiration for future research.