Predicting Vessel Trajectories Using ASTGCN with StemGNN-Derived Correlation Matrix

Dynamic traffic correlations based spatio-temporal graph convolutional network for urban traffic prediction

In recent years, human motion recognition in computer vision has become a hot research direction in this field. Based on 2D human motion recognition technology, real-time extraction of motion features from 2D planes is used to recognize human movements. This method can only learn the position contour and color information of the image. It cannot directly reflect the motion situation, which results in low recognition accuracy and efficiency. In response to this issue, this study proposes a combination method of motion recognition and 3D pose estimation to recognize and classify basketball movements. First, the 2D skeleton model is obtained by extracting the feature information in the video action, which is converted into a 3D model, and the model is replaced by the time-space convolutional network to establish a human action recognition model. The experiment showed that when the number of iterations reached 6, the accuracy of the spatio-temporal graph convolutional network algorithm model reached 92%. Comparing the accuracy rates of different algorithm models, the average accuracy rates of convolutional neural network, long short memory network, graph convolution, long short model of action recognition and graph convolution model of action recognition were 61.6%, 65.4%, 72.5%, 76.8% and 90.3% respectively. The results show that the proposed 3D recognition algorithm can accurately recognize different basketball movements. This study can provide reference for basketball coaches and athletes in basketball training.

This study introduces the MSTA-GNet (Multi-Scale Spatiotemporal Attention Graph Network), a novel deep learning model which integrates spatiotemporal self-attention mechanisms to model heterogeneous dependencies in traffic networks. The primary objective of the study is to improve existing traffic flow prediction models to address the inadequacies of traditional models in complex big data environments. Key innovations of the MSTA-GNet model include positional encoding and global and local self-attention mechanisms to capture long-term and short-term dependencies. Using the PeMS (Performance Measurement System) dataset, the study conducted performance comparison experiments among various deep learning models, including LSTM (Long Short-Term Memory), GCN (Graph Convolutional Network), DCRNN (Diffusion Convolutional Recurrent Neural Network), STGCN (Spatiotemporal Graph Convolutional Network), STMetaNet (Spatiotemporal Meta Network), and MSTA-GNet. The results showed that MSTA-GNet significantly outperformed other models with improvements of 13.4%, 11.8%, and 9.7% in Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Mean Absolute Percentage Error (MAPE) metrics, respectively. Ablation studies further validated the significance of attention mechanisms, feature extraction, convolutional layers, and graph networks, confirming the effectiveness and practical application of MSTA-GNet in traffic flow prediction. This research provides important insights for AI-based congestion management, support for low-carbon traffic networks, and optimization of local traffic operations, demonstrating its significant practical value in intelligent transportation systems.

In the realm of intelligent transportation systems, accurately predicting vehicle trajectories is paramount for enhancing road safety and optimizing traffic flow management. Addressing the impacts of complex traffic environments and efficiently modeling the diverse behaviors of vehicles are the key challenges at present. To achieve precise prediction of vehicle trajectories, it is essential to fully consider the dynamic changes in traffic conditions and the long-term dependencies of time-series data. In response to these challenges, we propose the Memory-Enhanced Spatio-Temporal Graph Network (MESTGN), an innovative model that integrates a Spatio-Temporal Graph Convolutional Network (STGCN) with an attention-enhanced Long Short-Term Memory (LSTM)-based sequence to sequence (Seq2Seq) encoder–decoder structure. MESTGN utilizes STGCN to capture the complex spatial dependencies between vehicles and reflects the interactions within the traffic network through road traffic data and network topology, which significantly influences trajectory prediction. Additionally, the model focuses on historical vehicle trajectory data points using an attention-weighted mechanism under a traditional LSTM prediction architecture, calculating the importance of critical trajectory points. Finally, our experiments conducted on the urban traffic dataset ApolloSpace validate the effectiveness of our proposed model. We demonstrate that MESTGN shows a significant performance improvement in vehicle trajectory prediction compared with existing mainstream models, thereby confirming its increased prediction accuracy.

Four-dimensional (4D) trajectory prediction plays a critical role in modern air traffic management, enabling applications such as conflict detection, anomaly monitoring, and congestion mitigation. However, existing methods have limited information sources when modeling potential spatial correlations between aircraft in complex airspace scenarios, and their final trajectory inference ability is weak, resulting in lower prediction accuracy. Faced with these challenges, we propose Modern Temporal and Dual Attention based Spatiotemporal Graph Convolutional Network (MTDA-STGCN), which employs a self-attention mechanism to reconstruct the adjacency matrix to enhance the ability of capturing global node correlations. This adjacency matrix reconstructed with the self-attention mechanism is dynamically optimized throughout the training process of network, offering a more nuanced reflection of the inter-node relationships compared to traditional algorithms. Subsequently, our model uses graph attention to extract additional global features for modeling accuracy interactions between aircraft. Finally, the output is input into the Modern Temporal Prediction Network (MTPN) to obtain the predicted trajectory probability distribution. The experiments on real-world ADS-B datasets demonstrate that MTDA-STGCN outperforms existing 4D trajectory prediction algorithms on all datasets. The proposed dual-attention framework significantly enhances the capture of node spatial correlations, while the MTPN module effectively improves the accuracy of the predicted results.

In order to provide intelligent and efficient healthcare services in the Internet of Medical Things (IoMT), human action recognition (HAR) can play a crucial role. As a result of their stringent requirements, such as high computational complexity and memory efficiency, classical HAR techniques are not applicable to modern and intelligent healthcare services, e.g., IoMT. To address these issues, we present in this paper a novel HAR technique for healthcare services in IoMT. This model, referred to as the spatio-temporal graph convolutional network (STGCN), primarily aims at skeleton-based human–machine interfaces. By independently extracting spatial and temporal features, STGCN significantly reduces information loss. Spatio-temporal information is extracted independently of the exact spatial and temporal point, ensuring the extraction of useful features for HAR. Using only joint data and fewer parameters, we demonstrate that our proposed STGCN achieved 92.2% accuracy on the skeleton dataset. Unlike multi-channel methods, which use a combination of joint and bone data and have a large number of parameters, multi-channel methods use both joint and bone data. As a result, STGCN offers a good balance between accuracy, memory consumption, and processing time, making it suitable for detecting medical conditions.

The spatiotemporal dynamics of traffic forecasting make it a challenging task. In recent years, by adapting to the topology of traffic networks where road segments serve as nodes, graph convolutional networks (GCNs) have been able to capture spatiotemporal dependencies, thereby improving traffic forecasting performance. However, there are two shortcomings of GCN-based methods: 1) existing methods treat the delays between nodes in the traffic network as equally important and fail to extract critical information effectively, leading to information redundancy, the introduction of irrelevant noise, and increased computational costs and 2) most methods overlook the issue that spatiotemporal correlations between nodes are inconsistent across different timescales. This article designs a new dynamic delay-aware multiscal spatiotemporal graph convolutional network (DDAMGCN) for traffic forecasting. Specifically, a dynamic delay-aware module is designed to identify key nodes and model the important delays from key nodes, so that the model focuses on key information and reduces computational cost. Additionally, a novel multiscale spatiotemporal graph convolution module is designed to achieve fine-grained modeling of the spatiotemporal correlation of different nodes at different timescales. Experiments on eight real traffic datasets verify the superiority of the proposed method compared to several state-of-the-art baselines.

Spatio-temporal graph convolutional networks (STGCN) have become popular recently because they can handle structured data with dynamic temporal variations. However, the lack of interpretability limits the potential application of STGCNs. Gradient-based class activation maps (Grad-CAM) are a popular technique to interpret convolutional neural networks for grid structured data such as images. In this paper, we design an extension of Grad-CAMs for spatio temporal graph convolution (STG-Grad-CAM) to improve the interpretability of STGCNs. As a proof of concept we provide results for a skeleton-based activity recognition task. We show which body joints are responsible for a particular task and how their temporal dynamics contribute to the classification output. We present a brief study of the interpretability of a recognition task by changing the model depth and the training and testing protocol. To find the efficacy of STG-Grad-CAM, we compute faithfulness of STG-Grad-CAM to the model measured by the impact of occlusions to the graph nodes. For explainability of STGCN, we compute contrastivity of the model for different classes based on the outcome of STG-Grad-CAM. In the cross-person setting, we observe better contrastivity than the cross-view setting.

Spatio-temporal graph signal analysis has a significant impact on a wide range of applications, including hand/body pose action recognition. To achieve effective analysis, spatio-temporal graph convolutional networks (ST-GCN) leverage the powerful learning ability to achieve great empirical successes; however, those methods need a huge amount of high-quality training data and lack theoretical interpretation. To address this issue, the spatio-temporal graph scattering transform (ST-GST) was proposed to put forth a theoretically interpretable framework; however, the empirical performance of this approach is constrained by the fully mathematical design. To benefit from both sides, this work proposes a novel complementary mechanism to organically combine the spatio-temporal graph scattering transform and neural networks, resulting in the proposed spatio-temporal graph complementary scattering networks (ST-GCSN). The essence is to leverage the mathematically designed graph wavelets with pruning techniques to cover major information and use trainable networks to capture complementary information. The empirical experiments on hand pose action recognition show that the proposed ST-GCSN outperforms both ST-GCN and ST-GST.

Occupational accidents in manufacturing industries pose a significant risk, necessitating advanced strategies to ensure worker safety and enhance operational productivity. The unpredictable nature of worker movements, influenced by varied tasks such as material transportation, machine operation, and collaborative efforts, highlights the critical need for effective trajectory prediction mechanisms. This paper introduces an innovative approach utilizing Spatio-Temporal Graph Attention Networks (STGAT) and Spatio-Temporal Graph Convolutional Neural Networks (STGCNN) to predict worker trajectories with high accuracy and to analyze worker interactions within the manufacturing environment. Our methodology employs qualitative evaluation techniques to reveal intricate worker dynamics during assembly line processes, offering new perspectives on spatial-temporal interplays in a factory setting. By applying this method to movement data from a detailed case study involving six workers on a tribike assembly line, we demonstrate the effectiveness of our proposed algorithm in real-world scenarios. The utilization of advanced Graph Neural Network technologies allows for the precise modeling of complex spatial-temporal relationships, enabling the accurate prediction of worker paths. This research contributes significantly to the fields of occupational safety and industrial efficiency by providing a comprehensive framework for anticipating worker movements and understanding their interactions in intricate manufacturing landscapes. Moreover, it addresses existing challenges in trajectory prediction and outlines potential directions for future research, aiming to broaden the application of predictive analytics in enhancing safety protocols and operational strategies in the manufacturing sector.

The reason why China’s table tennis can continue to this day is because it is an important heritage sports event in the country. In order to ensure the high-level performance of the Chinese table tennis team in the game, the identification and detection of its sports characteristics is a very meaningful work. With the development of computer technology, the use of multimedia intelligence technology to conduct research on competitive tactics has become a general consensus in the sports world. This paper explores the recognition and detection technology of the strength of table tennis hitting movements from the perspective of biomechanics, aiming to provide scientific basis and technical support for improving the performance of athletes. Based on the principles of biomechanics and combined with multimedia intelligent algorithms, this study developed a spatiotemporal graph convolutional network (STGCN) and a motion detection method based on Kinect technology to identify and quantify the hitting strength of table tennis players. The experimental results of this paper show that in the recognition of different types of movements based on the STGCN method, the correct recognition rate of 100 groups of movement strength is 84%, and the correct recognition rate of 500 groups of movement strength is 91.6%; in the recognition of different types of movement strength based on Kinect, the correct recognition rate of 100 groups of movement strength is 97%, and the correct recognition rate of 500 groups of movement strength is 99.6%; it can be seen that no matter how many groups of hitting movements are made, the correct recognition rate of strength based on Kinect is higher than that of STGCN.

IntroductionAccurately recognizing and understanding human motion actions presents a key challenge in the development of intelligent sports robots. Traditional methods often encounter significant drawbacks, such as high computational resource requirements and suboptimal real-time performance. To address these limitations, this study proposes a novel approach called Sports-ACtrans Net.MethodsIn this approach, the Swin Transformer processes visual data to extract spatial features, while the Spatio-Temporal Graph Convolutional Network (ST-GCN) models human motion as graphs to handle skeleton data. By combining these outputs, a comprehensive representation of motion actions is created. Reinforcement learning is employed to optimize the action recognition process, framing it as a sequential decision-making problem. Deep Q-learning is utilized to learn the optimal policy, thereby enhancing the robot's ability to accurately recognize and engage in motion.Results and discussionExperiments demonstrate significant improvements over state-of-the-art methods. This research advances the fields of neural computation, computer vision, and neuroscience, aiding in the development of intelligent robotic systems capable of understanding and participating in sports activities.

Spatio-temporal Graph Convolutional Networks (ST-GCNs) have shown great performance in the context of skeleton-based action recognition. Nevertheless, ST-GCNs use raw skeleton data as vertex features. Such features have low dimensionality and might not be optimal for action discrimination. Moreover, a single layer of temporal convolution is used to model short-term temporal dependencies but can be insufficient for capturing both long-term. In this paper, we extend the Spatio-Temporal Graph Convolutional Network for skeleton-based action recognition by introducing two novel modules, namely, the Graph Vertex Feature Encoder (GVFE) and the Dilated Hierarchical Temporal Convolutional Network (DH-TCN). On the one hand, the GVFE module learns appropriate vertex features for action recognition by encoding raw skeleton data into a new feature space. On the other hand, the DH-TCN module is capable of capturing both short-term and long-term temporal dependencies using a hierarchical dilated convolutional network. Experiments have been conducted on the challenging NTU RGB-D 60, NTU RGB-D 120 and Kinetics datasets. The obtained results show that our method competes with state-of-the-art approaches while using a smaller number of layers and parameters; thus reducing the required training time and memory.

Spatio-temporal Graph Convolutional Networks (ST-GCNs) have shown great performance in the context of skeleton-based action recognition. Nevertheless, ST-GCNs use raw skeleton data as vertex features. Such features have low dimensionality and might not be optimal for action discrimination. Moreover, a single layer of temporal convolution is used to model short-term temporal dependencies but can be insufficient for capturing both long-term. In this paper, we extend the Spatio-Temporal Graph Convolutional Network for skeleton-based action recognition by introducing two novel modules, namely, the Graph Vertex Feature Encoder (GVFE) and the Dilated Hierarchical Temporal Convolutional Network (DH-TCN). On the one hand, the GVFE module learns appropriate vertex features for action recognition by encoding raw skeleton data into a new feature space. On the other hand, the DH-TCN module is capable of capturing both short-term and long-term temporal dependencies using a hierarchical dilated convolutional network. Experiments have been conducted on the challenging NTU RGB-D 60, NTU RGB-D 120 and Kinetics datasets. The obtained results show that our method competes with state-of-the-art approaches while using a smaller number of layers and parameters; thus reducing the required training time and memory.

Connected and Automated Vehicles (CAV) have been rapidly developed, which, inevitably, renders that human-driven and autonomous vehicles share the road. Thus, trajectory prediction is an important research topic, which helps each CAV to efficiently follow a Human-Driven Vehicle (HV). In a wider scope, trajectory prediction, also, helps to improve the throughput of traffic flow and enhance its stability. To realize the trajectory prediction of Connected and Automated Vehicles to Human-Driven Vehicles, a car-following model, which is based on trajectory data, was established. Adding deep neural networks and an Attention mechanism, this paper established a data-driven car-following model, based on CNN-BiLSTM-Attention for CAV, to predict trajectory, by referring to the modeling idea of the traditional car-following model. The trajectory data in the next-generation-simulation (NGSIM) datasets that match the car-following characteristics were selected. In addition, noise-reduction pre-processing of the trajectory data was performed, to make it match the actual car-following situation. Experiments, for selecting the optimal structure of the model and the method of trajectory prediction, were carried out. The data-driven car-following models, such as LSTM, GRU, and CNN-BiLSTM, were selected for comparative analysis of trajectory prediction. The results show that the CNN-BiLSTM-Attention model has the smallest MAE and MSE as well as the largest R2. The CNN-BiLSTM-Attention model has the highest accuracy in vehicle-trajectory prediction. The model can, effectively, realize vehicle-trajectory prediction and provide a theoretical basis for vehicle-trajectory-based velocity guidance of Human-Driven Vehicles. In the future, the model can, also, provide the theoretical basis for Connected and Automated Vehicles, to make car-following decisions in mixed traffic flow.