Dynamic Perception-Based Vehicle Trajectory Prediction Using a Memory-Enhanced Spatio-Temporal Graph Network

This study introduces the MSTA-GNet (Multi-Scale Spatiotemporal Attention Graph Network), a novel deep learning model which integrates spatiotemporal self-attention mechanisms to model heterogeneous dependencies in traffic networks. The primary objective of the study is to improve existing traffic flow prediction models to address the inadequacies of traditional models in complex big data environments. Key innovations of the MSTA-GNet model include positional encoding and global and local self-attention mechanisms to capture long-term and short-term dependencies. Using the PeMS (Performance Measurement System) dataset, the study conducted performance comparison experiments among various deep learning models, including LSTM (Long Short-Term Memory), GCN (Graph Convolutional Network), DCRNN (Diffusion Convolutional Recurrent Neural Network), STGCN (Spatiotemporal Graph Convolutional Network), STMetaNet (Spatiotemporal Meta Network), and MSTA-GNet. The results showed that MSTA-GNet significantly outperformed other models with improvements of 13.4%, 11.8%, and 9.7% in Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Mean Absolute Percentage Error (MAPE) metrics, respectively. Ablation studies further validated the significance of attention mechanisms, feature extraction, convolutional layers, and graph networks, confirming the effectiveness and practical application of MSTA-GNet in traffic flow prediction. This research provides important insights for AI-based congestion management, support for low-carbon traffic networks, and optimization of local traffic operations, demonstrating its significant practical value in intelligent transportation systems.

Spatio-temporal graph signal analysis has a significant impact on a wide range of applications, including hand/body pose action recognition. To achieve effective analysis, spatio-temporal graph convolutional networks (ST-GCN) leverage the powerful learning ability to achieve great empirical successes; however, those methods need a huge amount of high-quality training data and lack theoretical interpretation. To address this issue, the spatio-temporal graph scattering transform (ST-GST) was proposed to put forth a theoretically interpretable framework; however, the empirical performance of this approach is constrained by the fully mathematical design. To benefit from both sides, this work proposes a novel complementary mechanism to organically combine the spatio-temporal graph scattering transform and neural networks, resulting in the proposed spatio-temporal graph complementary scattering networks (ST-GCSN). The essence is to leverage the mathematically designed graph wavelets with pruning techniques to cover major information and use trainable networks to capture complementary information. The empirical experiments on hand pose action recognition show that the proposed ST-GCSN outperforms both ST-GCN and ST-GST.

This study proposes a vessel position prediction method using attention spatiotemporal graph convolutional networks, which addresses the issue of low prediction accuracy due to less consideration of inter-feature dependencies in current vessel trajectory prediction methods. First, the method cleans the vessel trajectory data and uses the Time-ratio trajectory compression algorithm to compress the trajectory data, avoiding data redundancy and providing feature points for vessel trajectories. Second, the Spectral Temporal Graph Neural Network (StemGNN) extracts the correlation matrix that describes the relationship between multiple variables as a priori matrix input to the prediction model. Then the vessel trajectory prediction model is constructed, and the attention mechanism is added to the spatial and temporal dimensions of the trajectory data based on the spatio-temporal graph convolutional network at the same time as the above operations are performed on different time scales. Finally, the features extracted from different time scales are fused through the full connectivity layer to predict the future trajectories. Experimental results show that this method achieves higher accuracy and more stable prediction results in trajectory prediction. The attention-based spatio-temporal graph convolutional networks effectively capture the spatio-temporal correlations of the main features in vessel trajectories, and the spatio-temporal attention mechanism and graph convolution have certain interpretability for the prediction results.

Occupational accidents in manufacturing industries pose a significant risk, necessitating advanced strategies to ensure worker safety and enhance operational productivity. The unpredictable nature of worker movements, influenced by varied tasks such as material transportation, machine operation, and collaborative efforts, highlights the critical need for effective trajectory prediction mechanisms. This paper introduces an innovative approach utilizing Spatio-Temporal Graph Attention Networks (STGAT) and Spatio-Temporal Graph Convolutional Neural Networks (STGCNN) to predict worker trajectories with high accuracy and to analyze worker interactions within the manufacturing environment. Our methodology employs qualitative evaluation techniques to reveal intricate worker dynamics during assembly line processes, offering new perspectives on spatial-temporal interplays in a factory setting. By applying this method to movement data from a detailed case study involving six workers on a tribike assembly line, we demonstrate the effectiveness of our proposed algorithm in real-world scenarios. The utilization of advanced Graph Neural Network technologies allows for the precise modeling of complex spatial-temporal relationships, enabling the accurate prediction of worker paths. This research contributes significantly to the fields of occupational safety and industrial efficiency by providing a comprehensive framework for anticipating worker movements and understanding their interactions in intricate manufacturing landscapes. Moreover, it addresses existing challenges in trajectory prediction and outlines potential directions for future research, aiming to broaden the application of predictive analytics in enhancing safety protocols and operational strategies in the manufacturing sector.

The spatiotemporal dynamics of traffic forecasting make it a challenging task. In recent years, by adapting to the topology of traffic networks where road segments serve as nodes, graph convolutional networks (GCNs) have been able to capture spatiotemporal dependencies, thereby improving traffic forecasting performance. However, there are two shortcomings of GCN-based methods: 1) existing methods treat the delays between nodes in the traffic network as equally important and fail to extract critical information effectively, leading to information redundancy, the introduction of irrelevant noise, and increased computational costs and 2) most methods overlook the issue that spatiotemporal correlations between nodes are inconsistent across different timescales. This article designs a new dynamic delay-aware multiscal spatiotemporal graph convolutional network (DDAMGCN) for traffic forecasting. Specifically, a dynamic delay-aware module is designed to identify key nodes and model the important delays from key nodes, so that the model focuses on key information and reduces computational cost. Additionally, a novel multiscale spatiotemporal graph convolution module is designed to achieve fine-grained modeling of the spatiotemporal correlation of different nodes at different timescales. Experiments on eight real traffic datasets verify the superiority of the proposed method compared to several state-of-the-art baselines.

Dynamic traffic correlations based spatio-temporal graph convolutional network for urban traffic prediction

Four-dimensional (4D) trajectory prediction plays a critical role in modern air traffic management, enabling applications such as conflict detection, anomaly monitoring, and congestion mitigation. However, existing methods have limited information sources when modeling potential spatial correlations between aircraft in complex airspace scenarios, and their final trajectory inference ability is weak, resulting in lower prediction accuracy. Faced with these challenges, we propose Modern Temporal and Dual Attention based Spatiotemporal Graph Convolutional Network (MTDA-STGCN), which employs a self-attention mechanism to reconstruct the adjacency matrix to enhance the ability of capturing global node correlations. This adjacency matrix reconstructed with the self-attention mechanism is dynamically optimized throughout the training process of network, offering a more nuanced reflection of the inter-node relationships compared to traditional algorithms. Subsequently, our model uses graph attention to extract additional global features for modeling accuracy interactions between aircraft. Finally, the output is input into the Modern Temporal Prediction Network (MTPN) to obtain the predicted trajectory probability distribution. The experiments on real-world ADS-B datasets demonstrate that MTDA-STGCN outperforms existing 4D trajectory prediction algorithms on all datasets. The proposed dual-attention framework significantly enhances the capture of node spatial correlations, while the MTPN module effectively improves the accuracy of the predicted results.

Vehicle trajectory information is a crucial part of improving the efficiency and the safety of the ITS. Data missing or irregular sampling in the real-world road traffic makes it hard to obtain accurate real-time vehicle trajectories. In this paper, we focus on trajectory imputation and prediction tasks with small data (magnitude set as 10 1 and 10 2 ). Limited by insufficient data, the simulation results of the existing data-driven algorithms are unsatisfactory. With car-following models integrated as prior physical information to constrain the training process, we design the car-following-informed neural network (CFINN). A multi-head self-attention layer is attached to the fully connected network layer to extract vehicle features. Different from the structure of most neural networks in regression analysis, an extra physics-based dataset is constructed in the CFINN. The loss function consists of two parts including the given trajectory's fitting error and the generated trajectory's residual error. We embed the gated recurrent unit-based encoder–decoder layer to the CFINN framework for trajectory predictions. The rationality and the superiority of our model are validated on the NGSIM dataset and the HighD dataset. Compared with baseline models in both single-vehicle and queue-typed trajectory imputation experiments, lower error can be achieved via the CFINN and coefficients of car-following models can be calibrated. According to driving regimes derived from CFINN-based trajectory prediction experiments, we discuss the impact of cut-in behaviours on the target vehicle and carry out the kinetic analysis. The novel neural network model driven by both data and physical knowledge provides technical support in vehicle status assessments and trajectory predictions.

Optimizing the energy consumption of an MEC (Multi-Access Edge Computing) system is a crucial challenge for operation cost reduction and environmental conservation. In this paper, we address an MECS (MEC Server) sleep control problem that aims to reduce the energy consumption of the system while providing users with a reasonable service delay by adjusting the number of active MECSs according to the load imposed on the system. To tackle the problem, we identify two crucial issues that influence the design of an effective sleep control technique and propose methods to address each of these issues. The first issue is accurately predicting the system load. Changes in system load are spatio-temporally correlated among MECSs. By leveraging such correlation information with STGCN (Spatio-Temporal Graph Convolutional Network), we enhance the prediction accuracy of task arrival rates for each MECS. The second issue is rapidly selecting MECSs to sleep when the load distribution over an MEC system is given. The problem of choosing sleep MECS is a combinatorial optimization problem with high time complexity. To address the issue, we employ a genetic algorithm and quickly determine the optimal sleep MECS with the predicted load information for each MECS. Through simulation studies, we verify that compared to the LSTM (Long Short-Term Memory)-based method, our method increases the energy efficiency of an MEC system while providing a compatible service delay.

In order to provide intelligent and efficient healthcare services in the Internet of Medical Things (IoMT), human action recognition (HAR) can play a crucial role. As a result of their stringent requirements, such as high computational complexity and memory efficiency, classical HAR techniques are not applicable to modern and intelligent healthcare services, e.g., IoMT. To address these issues, we present in this paper a novel HAR technique for healthcare services in IoMT. This model, referred to as the spatio-temporal graph convolutional network (STGCN), primarily aims at skeleton-based human–machine interfaces. By independently extracting spatial and temporal features, STGCN significantly reduces information loss. Spatio-temporal information is extracted independently of the exact spatial and temporal point, ensuring the extraction of useful features for HAR. Using only joint data and fewer parameters, we demonstrate that our proposed STGCN achieved 92.2% accuracy on the skeleton dataset. Unlike multi-channel methods, which use a combination of joint and bone data and have a large number of parameters, multi-channel methods use both joint and bone data. As a result, STGCN offers a good balance between accuracy, memory consumption, and processing time, making it suitable for detecting medical conditions.

Spatio-temporal heterogeneous graph using multivariate earth observation time series: Application for drought forecasting

In order to accurately predict the lane‐changing trajectory of the vehicle and improve the driving safety of the vehicle, a lane‐changing trajectory prediction model based on the combination of convolutional neural network (CNN) and bidirectional long short‐term memory (BiLSTM) neural network is proposed by comprehensively considering the historical driving behavior, the spatial characteristics of surrounding vehicles and the bidirectional time sequence information of the vehicle trajectory. Firstly, the vehicle trajectory data are filtered and smoothed, and it is divided into three categories: left lane change, right lane change, and straight driving, and a lane change trajectory sample set is constructed. Secondly, CNN‐BiLSTM model is constructed to identify the sample set of lane‐changing trajectory. Considering the interaction between vehicles in the driving process, the information of predicted vehicle, and surrounding vehicles is taken as the input of the model. The extracted feature vector is input to the BiLSTM layer for prediction after the CNN layer feature extraction, and the horizontal and vertical coordinates of the target vehicle at the next time are output. Thirdly, the trajectory data of the US‐101 dataset in NGSIM is selected to verify the performance of the CNN‐BiLSTM model, and at the same time, it is compared with models such as CNN‐LSTM, long short‐term memory (LSTM), BiLSTM, and CNN‐GRU‐Att. Finally, the verification result shows that the overall fitting degree of the vehicle lane change trajectory prediction of the proposed model reaches 99.50%, and the mean square error and mean absolute error are 0.0003076 and 0.01417, which are improved compared with other models. In the meanwhile, the research on multistep trajectory prediction in different prediction time domains is carried out. It was found that the longer the prediction time domain is, the lower the prediction performance of the model decreases, but the prediction accuracy still reached more than 96%, and it was able to accurately predict the lane change trajectory.

The reason why China’s table tennis can continue to this day is because it is an important heritage sports event in the country. In order to ensure the high-level performance of the Chinese table tennis team in the game, the identification and detection of its sports characteristics is a very meaningful work. With the development of computer technology, the use of multimedia intelligence technology to conduct research on competitive tactics has become a general consensus in the sports world. This paper explores the recognition and detection technology of the strength of table tennis hitting movements from the perspective of biomechanics, aiming to provide scientific basis and technical support for improving the performance of athletes. Based on the principles of biomechanics and combined with multimedia intelligent algorithms, this study developed a spatiotemporal graph convolutional network (STGCN) and a motion detection method based on Kinect technology to identify and quantify the hitting strength of table tennis players. The experimental results of this paper show that in the recognition of different types of movements based on the STGCN method, the correct recognition rate of 100 groups of movement strength is 84%, and the correct recognition rate of 500 groups of movement strength is 91.6%; in the recognition of different types of movement strength based on Kinect, the correct recognition rate of 100 groups of movement strength is 97%, and the correct recognition rate of 500 groups of movement strength is 99.6%; it can be seen that no matter how many groups of hitting movements are made, the correct recognition rate of strength based on Kinect is higher than that of STGCN.

IntroductionAccurately recognizing and understanding human motion actions presents a key challenge in the development of intelligent sports robots. Traditional methods often encounter significant drawbacks, such as high computational resource requirements and suboptimal real-time performance. To address these limitations, this study proposes a novel approach called Sports-ACtrans Net.MethodsIn this approach, the Swin Transformer processes visual data to extract spatial features, while the Spatio-Temporal Graph Convolutional Network (ST-GCN) models human motion as graphs to handle skeleton data. By combining these outputs, a comprehensive representation of motion actions is created. Reinforcement learning is employed to optimize the action recognition process, framing it as a sequential decision-making problem. Deep Q-learning is utilized to learn the optimal policy, thereby enhancing the robot's ability to accurately recognize and engage in motion.Results and discussionExperiments demonstrate significant improvements over state-of-the-art methods. This research advances the fields of neural computation, computer vision, and neuroscience, aiding in the development of intelligent robotic systems capable of understanding and participating in sports activities.

Spatio-temporal Graph Convolutional Networks (ST-GCNs) have shown great performance in the context of skeleton-based action recognition. Nevertheless, ST-GCNs use raw skeleton data as vertex features. Such features have low dimensionality and might not be optimal for action discrimination. Moreover, a single layer of temporal convolution is used to model short-term temporal dependencies but can be insufficient for capturing both long-term. In this paper, we extend the Spatio-Temporal Graph Convolutional Network for skeleton-based action recognition by introducing two novel modules, namely, the Graph Vertex Feature Encoder (GVFE) and the Dilated Hierarchical Temporal Convolutional Network (DH-TCN). On the one hand, the GVFE module learns appropriate vertex features for action recognition by encoding raw skeleton data into a new feature space. On the other hand, the DH-TCN module is capable of capturing both short-term and long-term temporal dependencies using a hierarchical dilated convolutional network. Experiments have been conducted on the challenging NTU RGB-D 60, NTU RGB-D 120 and Kinetics datasets. The obtained results show that our method competes with state-of-the-art approaches while using a smaller number of layers and parameters; thus reducing the required training time and memory.