Optimized Graph Convolution Recurrent Neural Network for Traffic Prediction

With the advancement of modern UAV technology, UAVs have become integral to creating traffic management monitoring systems. Additionally, UAV-based traffic monitoring systems can predict traffic flow by integrating machine learning methods. Specifically, traffic flow data contains both spatial and temporal information, which can be effectively processed by graph neural networks (GNNs). However, GNNs often face the challenge of oversmoothing, which hinders their ability to capture complex structures in the data. The Spatio-Temporal Graph Ordinary Differential Equations (STGODE) model addresses this issue by introducing Neural Ordinary Differential Equations (NODEs) to construct deeper GNNs. Despite this, STGODE relies on initially predefined semantic neighborhood matrices, which do not adapt well to the dynamic nature of traffic information. To overcome this limitation, we propose an evolutionary graph neural network for traffic prediction, capable of continuously updating the semantic adjacency matrix throughout the training process. This dynamic evolution of the semantic adjacency matrix allows it to adapt to the features and semantic relations of the current data, enhancing its ability to capture the complexity and variability of traffic patterns. We validate our approach through experiments on several real-world datasets, demonstrating that our method outperforms state-of-the-art benchmarks.

Dynamic multi-scale spatial–temporal graph convolutional network for traffic flow prediction

The increasing complexity of urban transportation systems and the growing volume of vehicles have made traffic congestion a persistent challenge in modern cities. Efficient traffic flow prediction is essential for mitigating congestion, improving road safety, optimizing traffic signal control, and enhancing overall transportation efficiency. In recent years, artificial intelligence (AI) has emerged as a transformative tool in the field of traffic management, offering sophisticated algorithms capable of modeling, analyzing, and predicting complex traffic patterns with high accuracy. The application of AI in traffic flow prediction leverages vast amounts of real-time and historical data to generate precise forecasts, supporting data-driven decision-making by urban planners and traffic control authorities. The prediction of traffic flow involves analyzing time-series data that exhibit nonlinear, dynamic, and often stochastic behavior. Traditional statistical models, such as autoregressive integrated moving average (ARIMA), have proven to be limited in handling the high dimensionality and variability inherent in traffic systems. In contrast, AI algorithms possess the capacity to learn and adapt from complex data inputs without the need for explicit programming, making them particularly suitable for traffic-related applications. AI algorithms used in traffic flow prediction can be broadly categorized into machine learning (ML) and deep learning (DL) approaches. Machine learning algorithms such as k-nearest neighbors (KNN), support vector machines (SVM), decision trees, and random forests have demonstrated effectiveness in short-term traffic prediction tasks. These algorithms are capable of identifying hidden patterns in traffic data and adjusting to changes in traffic behavior over time. Ensemble methods, which combine the strengths of multiple learning models, further enhance prediction accuracy and robustness. Deep learning algorithms, a subfield of AI inspired by the human brain’s neural architecture, have shown exceptional performance in capturing spatial-temporal dependencies in traffic data. Recurrent neural networks (RNNs), particularly long short-term memory (LSTM) networks and gated recurrent units (GRUs), are widely used for their ability to process sequential data and retain information over extended time intervals. Convolutional neural networks (CNNs) are employed to extract spatial features from traffic sensor data or road network imagery. Hybrid models that integrate CNNs with RNNs have achieved high levels of predictive precision by simultaneously learning spatial and temporal correlations. In addition to supervised learning methods, unsupervised and reinforcement learning techniques are also applied in traffic flow prediction. Clustering algorithms, such as k-means and DBSCAN, assist in identifying traffic patterns, while reinforcement learning models optimize adaptive traffic signal control systems by learning optimal actions through environmental interaction. This study explores the different types of AI algorithms used in traffic flow prediction, examining their theoretical foundations, structural differences, and practical applications. It aims to evaluate the comparative advantages of various algorithms in addressing the challenges of real-time traffic prediction in increasingly complex transportation networks.

Accurate traffic prediction is crucial to alleviating traffic congestion in cities. Existing physical sensor-based traffic data acquisition methods have high transmission costs, serious traffic information redundancy, and large calculation volumes for spatiotemporal data processing, thus making it difficult to ensure accuracy and real-time traffic prediction. With the increasing resolution of UAV imagery, the use of unmanned aerial vehicles (UAV) imagery to obtain traffic information has become a hot spot. Still, analyzing and predicting traffic status after extracting traffic information is neglected. We develop a framework for traffic speed extraction and prediction based on UAV imagery processing, which consists of two parts: a traffic information extraction module based on UAV imagery recognition and a traffic speed prediction module based on deep learning. First, we use deep learning methods to automate the extraction of road information, implement vehicle recognition using convolutional neural networks and calculate the average speed of road sections based on panchromatic and multispectral image matching to construct a traffic prediction dataset. Then, we propose an attention-enhanced traffic speed prediction module that considers the spatiotemporal characteristics of traffic data and increases the weights of key roads by extracting important fine-grained spatiotemporal features twice to improve the prediction accuracy of the target roads. Finally, we validate the effectiveness of the proposed method on real data. Compared with the baseline algorithm, our algorithm achieves the best prediction performance regarding accuracy and stability.

For providing drivers with robust traffic information and Optimizing the energy management of Hybrid Electric Vehicles (HEVs), it is important to predict traffic information accurately with past traffic information. As acquisition of the traffic information have been easier by the development of Intelligent Transportation System (ITS), active study on traffic prediction is currently underway. Multi-Layer Perceptron (MLP) model have been widely utilized for predicting traffic information since it is appropriate to represent the non-linear characteristics inherent in traffic prediction. However, the MLP model doesn't reflect local dependencies of traffic data and is prone to noise in traffic data. Convolutional Neural Networks (CNN) based model, on the other hand, can capture the local dependencies of traffic data and is less prone to disturbance in data. In this paper, we use temporal data and speed data collected on main roads in Seoul, South Korea to construct traffic prediction models. The speed data which are collected by every 5 minutes are provided by Ministry of Land, Infrastructure and Transport in South Korea. We construct the CNN based model and two MLP models which predict traffic speed and compare performance of the prediction models in this paper. The comparison results show that the CNN based model's prediction performance is higher than the prediction performance of the other two MLP models.

With the development of urbanization, the number of residents’ motor vehicles has increased sharply, and traffic congestion problem has become increasingly serious. The construction of Intelligent Traffic System (ITS) has become the main means to alleviate traffic congestion. Short-term traffic flow prediction has guiding significance for residents’ travel planning and intelligent management of transportation, and has become one of the research hotspots in intelligent transportation field.Therefore, A short-term traffic flow prediction method based on the spatio-temporal characteristics of complex road networks is proposed to further improve the prediction accuracy and reduce the prediction cost. Firstly, a graph convolutional network (GCN) capable of processing non-Euclidean data structures is used to extract the spatial characteristics of traffic flow data. Then, the long and short-term memory (LSTM) neural network is used to process the time characteristics. Finally, the two are combined to realize the effective processing of the spatio-temporal characteristics of traffic flow data. Experimental results on the real traffic flow dataset prove the feasibility and effectiveness of the proposed method, and can provide a basis for intelligent traffic control and smart city construction.

Traffic prediction is of great importance to traffic management and public safety, and very challenging as it is affected by many complex factors, such as spatial dependency of complicated road networks and temporal dynamics, and many more. The factors make traffic prediction a challenging task due to the uncertainty and complexity of traffic states. In the literature, many research works have applied deep learning methods on traffic prediction problems combining convolutional neural networks (CNNs) with recurrent neural networks (RNNs), which CNNs are utilized for spatial dependency and RNNs for temporal dynamics. However, such combinations cannot capture the connectivity and globality of traffic networks. In this paper, we first propose to adopt residual recurrent graph neural networks (Res-RGNN) that can capture graph-based spatial dependencies and temporal dynamics jointly. Due to gradient vanishing, RNNs are hard to capture periodic temporal correlations. Hence, we further propose a novel hop scheme into Res-RGNN to utilize the periodic temporal dependencies. Based on Res-RGNN and hop Res-RGNN, we finally propose a novel end-to-end multiple Res-RGNNs framework, referred to as “MRes-RGNN”, for traffic prediction. Experimental results on two traffic datasets have demonstrated that the proposed MRes-RGNN outperforms state-of-the-art methods significantly.

Parallelized training algorithm of MLP-BP neural network is implemented on the Sunway Blue Light Supercomputer. Efforts are mainly focused on the dada parallel method based on the characteristics of the training process. The implementation mainly depends on MPI techniques, which ensures the universality of the application. A new strategy of data partition and storage is applied in the parallelism. Tests of short-term traffic prediction which is significant in the intelligent transportation system are carried out to verify the accuracy and efficiency of the routines.

Short-term traffic speed prediction is a promising research topic in intelligent transportation systems (ITSs), which also plays an important role in the real-time decision-making of traffic control and guidance systems. However, the urban traffic speed has strong temporal, spatial correlation and the characteristic of complex nonlinearity and randomness, which makes it challenging to accurately and efficiently forecast short-term traffic speeds. We investigate the relevant literature and found that although most methods can achieve good prediction performance with the complete sample data, when there is a certain missing rate in the database, it is difficult to maintain accuracy with these methods. Recent studies have shown that deep learning methods, especially long short-term memory (LSTM) models, have good results in short-term traffic flow prediction. Furthermore, the attention mechanism can properly assign weights to distinguish the importance of traffic time sequences, thereby further improving the computational efficiency of the prediction model. Therefore, we propose a framework for short-term traffic speed prediction, including data preprocessing module and short-term traffic prediction module. In the data preprocessing module, the missing traffic data are repaired to provide a complete dataset for subsequent prediction. In the prediction module, a combined deep learning method that is an attention-based LSTM (ATT-LSTM) model for predicting short-term traffic speed on urban roads is proposed. The proposed framework was applied to the urban road network in Nanshan District, Shenzhen, Guangdong Province, China, with a 30-day traffic speed dataset (floating car data) used as the experimental sample. Results show that the proposed method outperforms other deep learning algorithms (such as recurrent neural network (RNN) and convolutional neural network (CNN)) in terms of both calculating efficiency and prediction accuracy. The attention mechanism can significantly reduce the error of the LSTM model (up to 12.4%) and improves the prediction performance.

Short-term traffic flow prediction plays an important role in intelligent transportation system. Numerous researchers have paid much attention to it in the past decades. However, the performance of traditional traffic flow prediction methods is not satisfactory, for those methods cannot describe the complicated nonlinearity and uncertainty of the traffic flow precisely. Neural networks were used to deal with the issues, but most of them failed to capture the deep features of traffic flow and be sensitive enough to the time-aware traffic flow data. In this paper, we propose a deep bi-directional long short-term memory (DBL) model by introducing long short-term memory (LSTM) recurrent neural network, residual connections, deeply hierarchical networks and bi-directional traffic flow. The proposed model is able to capture the deep features of traffic flow and take full advantage of time-aware traffic flow data. Additionally, we introduce the DBL model, regression layer and dropout training method into a traffic flow prediction architecture. We evaluate the prediction architecture on the dataset from Caltrans Performance Measurement System (PeMS). The experiment results demonstrate that the proposed model for short-term traffic flow prediction obtains high accuracy and generalizes well compared with other models.

Traffic flow prediction is an important part of intelligent transportation systems (ITS). However, sensor failures or the transmission distortion often occur in the process of data acquisition, which will inevitably cause the loss or abnormality of traffic flow data transmitted to the edge server. In this situation, it is necessary to share traffic flow data among different platforms. However, existing traffic flow prediction methods are facing two challenges in the process of traffic flow data sharing. First, user privacy is often leaked in the process of sharing traffic data on various platforms. Moreover, with the continuous updating of data, the efficiency and scalability of data sharing between different platforms will become lower and lower. In view of the above challenges, in this paper, we propose a novel prediction method for the missing traffic flow data caused by abnormal sensors, named ASMVP_{distr-LSH} based on distributed locality-sensitive hashing (LSH) technique. At last, a case study is presented to illustrate the feasibility and effectiveness of our approach ASMVP_{distr-LSH}.

Short-term traffic flow prediction can provide a basis for traffic management and support for travelers to make decisions. Accurate short-term traffic flow prediction also provides necessary conditions for the sustainable development of the traffic environment. Although the application of deep learning methods for traffic flow prediction has achieved good accuracy, the problem of combining multiple deep learning methods to improve the prediction accuracy of a single method still has a margin for in-depth research. In this article, a combined deep learning prediction (CDLP) model including two paralleled single deep learning models, CNN-LSTM-attention model and CNN-GRU-attention model, is established. In the model, a one-dimensional convolutional neural network (1DCNN) is used to extract traffic flow local trend features and RNN variants (LSTM and GRU) with attention mechanism are used to extract long temporal dependencies trend features. Moreover, a dynamic optimal weighted coefficient algorithm (DOWCA) is proposed to calculate the dynamic weights of CNN-LSTM-attention and CNN-GRU-attention with the goal of minimizing the sum of squared errors of the CDLP model. Then, the neuron number, loss function, optimization algorithm, and other parameters of the CDLP model are discussed and set through experiments. Finally, the training set and test set for the CDLP model are established through the processing of traffic flow data collected from the field. The CDLP model is trained and tested, and the prediction results of traffic flow are obtained and analyzed. It indicates that the CDLP model can fit the change trend of traffic flow very well and has better performance. Furthermore, under the same dataset, the results from the CDLP model are compared with baseline models. It is found that the CDLP model has higher prediction accuracy than baseline models.

Facilitating citizens with accurate traffic flow prediction increases the quality of life. Roadside sensors and devices are used to capture live streams of huge data and the Internet of Things (IoT) is becoming popular for the deployment of effective Intelligent Transportation Systems (ITS). Traffic flow prediction from the live datastreams require building a data-driven model. This is a challenging task and has attracted researchers for better interpretation of the traffic characteristics. The core problem in traffic prediction is modeling a diversity of traffic trends and unpredictable flow variations with temporal dependencies. Initially, statistical and shallow neural network models were applied to some extent. Recently, deep learning has come up with proven and promising outcomes. Gated Recurrent Unit (GRU) is a variation of recurrent neural networks used effectively for traffic flow prediction. Like other deep networks, GRU uses hyperparameters and a sliding window time-steps mechanism to prepare and tune the model. Better tuning for hyperparameters and search for optimal window size is a tedious process. In this research work, we present an algorithm for hyperparameters tuning along with sliding window steps optimization. Results obtained on a real-time public traffic dataset show a higher capability of the proposed method to reduce the error and an average gain of the optimized model over the untuned network is 4.5%. Furthermore, we apply the optimal hyperparameters obtained in the experiment to other deep learning models and present that our approach improves prediction accuracy and stability.

Short-term traffic speed prediction has become one of the most important parts of intelligent transportation systems (ITSs). In recent years, deep learning methods have demonstrated their superiority both in accuracy and efficiency. However, most of them only consider the temporal information, overlooking the spatial or some environmental factors, especially the different correlations between the target road and the surrounding roads. This paper proposes a traffic speed prediction approach based on temporal clustering and hierarchical attention (TCHA) to address the above issues. We apply temporal clustering to the target road to distinguish the traffic environment. Traffic data in each cluster have a similar distribution, which can help improve the prediction accuracy. A hierarchical attention-based mechanism is then used to extract the features at each time step. The encoder measures the importance of spatial features, and the decoder measures the temporal ones. The proposed method is evaluated over the data of a certain area in Hangzhou, and experiments have shown that this method can outperform the state of the art for traffic speed prediction.

Dynamic traffic correlations based spatio-temporal graph convolutional network for urban traffic prediction