Context Integrated Relational Spatio-Temporal Resource Forecasting

Traffic forecasting is a challenging task due to complex spatial and temporal dependencies across sensor locations and time. Interest in solving this task has increased, but current research focuses on manually constructing neural network architectures without the aid of neural architecture search (NAS). In our work, we explore evolutionary neural architecture search (ENAS) by deploying a genetic algorithm (GA) to find optimal neural network architectures for predicting traffic conditions. The search space for the GA consists of arbitrary combinations of dilated convolutions and graph convolutions for modelling temporal and spatial dependencies respectively, limited in complexity only by technical constraints. Experimental results show that model architectures obtained via GA are able to match the current state-of-the-art on traffic prediction benchmarks.

A central question in neuroscience is how self-organizing dynamic interactions in the brain emerge on their relatively static structural backbone. Due to the complexity of spatial and temporal dependencies between different brain areas, fully comprehending the interplay between structure and function is still challenging and an area of intense research. In this paper we present a graph neural network (GNN) framework, to describe functional interactions based on the structural anatomical layout. A GNN allows us to process graph-structured spatio-temporal signals, providing a possibility to combine structural information derived from diffusion tensor imaging (DTI) with temporal neural activity profiles, like that observed in functional magnetic resonance imaging (fMRI). Moreover, dynamic interactions between different brain regions discovered by this data-driven approach can provide a multi-modal measure of causal connectivity strength. We assess the proposed model’s accuracy by evaluating its capabilities to replicate empirically observed neural activation profiles, and compare the performance to those of a vector auto regression (VAR), like that typically used in Granger causality. We show that GNNs are able to capture long-term dependencies in data and also computationally scale up to the analysis of large-scale networks. Finally we confirm that features learned by a GNN can generalize across MRI scanner types and acquisition protocols, by demonstrating that the performance on small datasets can be improved by pre-training the GNN on data from an earlier study. We conclude that the proposed multi-modal GNN framework can provide a novel perspective on the structure-function relationship in the brain. Accordingly this approach appears to be promising for the characterization of the information flow in brain networks.

PSTFormer: A novel parallel spatial-temporal transformer for remaining useful life prediction of aeroengine

Multi-level Graph Memory Network Cluster Convolutional Recurrent Network for traffic forecasting

Understanding crowd behavior is a pivotal step toward urban scene analysis. This is considered a very challenging task and has rarely been addressed to date due to the complexity of motion dynamics co-occurring across a given scene, which involves spatial and temporal dependencies. Unlike the mainstream research, which usually treats the temporal and spatial dependencies in a crowd separately, this paper presents a deep end-to-end approach that jointly considers the spatiotemporal information, leading to a rich understanding of crowd behavior. We first extract the displacement information describing crowd motion patterns from tracklets/trajectories. This information is subsequently fed into a convolutional layer to learn the underlying motion patterns and create high-level representations. The derived representations are used as inputs to a long short-term memory-based architecture to learn the underlying spatiotemporal cues in a single operation for the entire crowd in a given scene. We evaluate our approach on a widely used, large-scale benchmark datasets for three critical applications: pedestrian path forecasting, destination estimation, and holistic crowd behavior classification. The results show a drastic improvement compared to recently trending works.

A latent variable representation of count data models to accommodate spatial and temporal dependence: Application to predicting crash frequency at intersections

The generation of synthetic time series is important in contemporary water sciences for their wide applicability and ability to model environmental uncertainty. Hydroclimatic variables often exhibit highly skewed distributions, intermittency (that is, alternating dry and wet intervals), and spatial and temporal dependencies that pose a particular challenge to their study. Vine copula models offer an appealing approach to generate synthetic time series because of their ability to preserve any marginal distribution while modeling a variety of probabilistic dependence structures. In this work, we focus on the stochastic modeling of hydroclimatic processes using vine copula models. We provide an approach to model intermittency by coupling Markov chains with vine copula models. Our approach preserves first-order auto- and cross-dependencies (correlation). Moreover, we present a novel framework that is able to model multiple processes simultaneously. This method is based on the coupling of temporal and spatial dependence models through repetitive sampling. The result is a parsimonious and flexible method that can adequately account for temporal and spatial dependencies. Our method is illustrated within the context of a recent reliability assessment of a historical hydraulic structure in central Mexico. Our results show that by ignoring important characteristics of probabilistic dependence that are well captured by our approach, the reliability of the structure could be severely underestimated.

Long-term prediction of physical systems on irregular unstructured meshes is extremely challenging due to the spatial complexityof meshes and the dynamic changes over time; namely, spatial dependence and temporal dependence. Recently, graph-based next-step prediction models have achieved great success in the task of modeling complex high-dimensional physical systems. However, due to these models ignoring the temporal dependence, they inevitably suffer from the effects of error accumulation. To capture the spatial and temporal dependence simultaneously, we propose a temporal graph network (TGN) to predict the long-term dynamics of complex physical systems. Specifically, we introduce an Encode-Process-Decode architecture to capture spatial dependence and create low-dimensional vector representations of system states. Additionally, a temporal model is introduced to learn the dynamic changes in the low-dimensional vector representations to capture temporal dependence. Our model can capture spatiotemporal correlations within physical systems. On some complex long-term prediction tasks in fluid dynamics, such as airfoil flow and cylinder flow, the prediction error of our method is significantly lower than the competitive GNN baseline. We show accurate phase predictions even for very long prediction sequences.

Traffic forecasting has emerged as an important task for developing intelligent transportation systems. Recent works focus on representing traffic as graph operation and using graph neural networks for spatial–temporal prediction. Most of the approaches assume a predefined graph structure based on node distances. However, spatial dependencies change over time in many scenarios of traffic flow. In this regard, this study takes an investigation capturing the spatial and temporal dependencies with no prior knowledge structure of traffic road networks. Specifically, we propose a multi-step prediction model named Dynamic Spatial Transformer WaveNet Network (DSTWN) to capture the dynamic conditions and directions of traffic flow in which a temporal convolution layer is adopted for the long time sequence and a spatial transformer layer is proposed to capture the dynamic spatial dependencies. Furthermore, we introduce a new traffic dataset, which is collected from the vehicle detection system in an urban area (UVDS). In particular, compared with existing benchmark traffic data, UVDS contains more complicated spatial information, which is similar to many real-world scenarios of traffic flow. Experiments on both benchmark traffic datasets indicate the promising results of DSTWN compared with state-of-the-art models in this research field.

Traffic forecasting is a crucial aspect of modern Intelligent Transportation Systems (ITS) and the Internet of Vehicles (IoV), playing a vital role in improving the safety and efficiency of daily transportation activities. Despite the valuable contributions of traditional machine learning (ML) models and advanced deep learning (DL) techniques, there persist challenges in capturing the intricate spatial and temporal dependencies inherent in traffic flow. In response to these challenges, we present GRAPHITE, an innovative framework that combines Graph Neural Networks (GNNs) and Generative Adversarial Networks (GANs) to leverage generative reasoning for efficient traffic management. Our model seamlessly integrates historical traffic volume data collected by road sensors with local spatial information encoded through knowledge graphs (KGs) associated with each sensor. These KGs offer a structured representation of relationships between traffic sensors and points of interest (POIs) in their neighborhood, thereby enhancing the comprehension of the urban context and leading to more accurate traffic predictions. Extensive experiments conducted on diverse datasets underscore the efficacy of GRAPHITE. Notably, we achieved a maximum decrease in RMSE of 31.05% compared to GAN-GRU and a maximum increase in R2 of 8.15% compared to GAN-RNN, positioning GRAPHITE as a standout solution among the current state-of-the-art approaches. Our code is available at: https://github.com/MODAL-UNINA/GRAPHITE.

Human Activity Recognition (HAR) is essential for monitoring and analyzing human behavior, particularly in health applications such as fall detection and chronic disease management. Traditional methods, even those incorporating attention mechanisms, often oversimplify the complex temporal and spatial dependencies in sensor data by processing features uniformly, leading to inadequate modeling of high-dimensional interactions. To address these limitations, we propose a novel framework: the Temporal-Spatial Feature Decoupling Unit with Layer-wise Training Convolutional Neural Network (CNN-TSFDU-LW). Our model enhances HAR accuracy by decoupling temporal and spatial dependencies, facilitating more precise feature extraction and reducing computational overhead. The TSFDU mechanism enables parallel processing of temporal and spatial features, thereby enriching the learned representations. Furthermore, layer-wise training with a local error function allows for independent updates of each CNN layer, reducing the number of parameters and improving memory efficiency without compromising performance. Experiments on four benchmark datasets (UCI-HAR, PAMAP2, UNIMIB-SHAR, and USC-HAD) demonstrate accuracy improvements ranging from 0.9% to 4.19% over state-of-the-art methods while simultaneously reducing computational complexity. Specifically, our framework achieves accuracy rates of 97.90% on UCI-HAR, 94.34% on PAMAP2, 78.90% on UNIMIB-SHAR, and 94.71% on USC-HAD, underscoring its effectiveness in complex HAR tasks. In conclusion, the CNN-TSFDU-LW framework represents a significant advancement in sensor-based HAR, delivering both improved accuracy and computational efficiency, with promising potential for enhancing health monitoring applications.

As one of the most widely used applications of the Internet of Things (IoT), intelligent transportation system (ITS) is of great significance for urban traffic planning, traffic control, and traffic guidance. However, widespread traffic congestion occurs with the increased number of vehicles. The traffic flow prediction is a good idea for traffic congestion. Therefore, many schemes have been proposed for accurate and real-time traffic flow prediction, but there still exist many issues, including low accuracy, weak adaptability and inferior real-time. Meanwhile, the complex spatial and temporal dependencies in traffic flow are still challenging. To address the above issues, we propose a novel spatial-temporal Chebyshev graph neural network model (ST-ChebNet) for traffic flow prediction to capture the spatial-temporal features, which can ensure accurate traffic flow prediction. Concretely, we first add a fully connected layer to fuse the features of traffic data into a new feature to generate a matrix, and then the long short-term memory (LSTM) model is adopted to learn traffic state changes for capturing the temporal dependencies. Then, we use the Chebyshev graph neural network (ChebNet) to learn the complex topological structures in the traffic network for capturing the spatial dependencies. Eventually, the spatial features and the temporal features are fused to guarantee the traffic flow prediction. The experiments show that ST-ChebNet can make accurate and real-time traffic flow prediction compared with other eight baseline methods on real-world traffic data sets PeMS.

Predicting the number of rented and returned bikes at each station is crucial for operators to proactively manage shared bike relocation. Although existing research has proposed spatial-temporal prediction models that significantly advance traffic prediction, these models often neglect the unique characteristics of shared bike systems (BSS). Spatially, the entire bike-sharing system (BSS) experiences peak activity during morning and evening rush hours, whereas, during other periods, activity is localized to local stations, with some recording no rides, highlighting the need to distinguish between global and local spatial information across different times. Temporally, the historical riding records for each station exhibit non-stationary patterns, necessitating the analysis of both global trends and local fluctuations. Existing Graph Neural Network (GNN) approaches to predicting shared bike demand primarily capture static spatial-temporal data and fail to account for the dynamic nature of bike flows. Moreover, these studies focus on global spatial-temporal information without considering local nuances, making it challenging to capture spatiotemporal dynamics in fluctuating BSS. To address these challenges, we introduce the Spatial-Temporal Aggregated Graph Neural Network (STAGNN). Our model first constructs a dynamic adjacent matrix to describe the evolving connections between stations, followed by local and global information layers to capture spatial-temporal information from large-scale shared bike networks accurately. Our methodology has been validated through experiments on four real-world datasets, comparing it against benchmark models to demonstrate superior prediction accuracy. Additionally, we conduct extended experiments on four datasets during the morning and evening rush hours, and the results also affirm the efficacy of the STAGNN in enhancing prediction performance.

Landslide displacement prediction has garnered significant recognition as a pivotal component in realizing successful early warnings and implementing effective control measures. This task remains challenging as landslide deformation involves not only temporal dependency within time series data but also spatial dependence across various regions within landslides. The present study proposes a landslide spatiotemporal displacement forecasting model by introducing attention-based deep learning algorithms based on spatiotemporal analysis. The Maximal Information Coefficient (MIC) approach is employed to quantify the spatial and temporal correlations within the daily data of Global Navigation Satellite System (GNSS) observations. Based on the quantitative spatiotemporal analysis, the proposed prediction model combines a convolutional neural network (CNN) and long short-term memory (LSTM) network to capture spatial and temporal dependencies individually. Spatial–temporal attention mechanisms are implemented to optimize the model. Additionally, we develop a single-point prediction model using LSTM and a multiple-point prediction model using the CNN-LSTM without an attention mechanism to compare the forecasting capabilities of the attention-based CNN-LSTM model. The Outang landslide in the Three Gorges Reservoir Area (TGRA), characterized by a large and active landslide equipped with an advanced monitoring system, is taken as a studied case. The temporal MIC results shed light on the response times of monitored daily displacement to external factors, showing a lagging duration of between 10 and 50 days. The spatial MIC results indicate mutual influence among different locations within the landslide, particularly in the case of nearby sites experiencing significant deformation. The attention-based CNN-LSTM model demonstrates an impressive predictive performance across six monitoring stations within the Outang landslide area. Notably, it achieves a remarkable maximum coefficient of determination (R2) value of 0.9989, accompanied by minimum values for root mean squared error (RMSE), absolute mean error (MAE), and mean absolute percentage error (MAPE), specifically, 1.18 mm, 0.99 mm, and 0.33%, respectively. The proposed model excels in predicting displacements at all six monitoring points, whereas other models demonstrate strong performance at specific individual stations but lack consistent performance across all stations. This study, involving quantitative deformation characteristics analysis and spatiotemporal displacement prediction, holds promising potential for a more profound understanding of landslide evolution and a significant contribution to reducing landslide risk.

Dynamic multi-scale spatial–temporal graph convolutional network for traffic flow prediction