Authors
This is the official pytorch implementation of our paper SST-GNN: Simplified Spatio-temporal Traffic forecasting model using Graph Neural Network which has been accepted by PAKDD 2021. Check the video presentation of our paper here.
To capture spatial relationships and temporal dynamics in traffic data, spatio-temporal models for traffic forecasting have drawn significant attention in recent years. Most of the recent works employed graph neural networks(GNN) with multiple layers to capture the spatial dependency. However, road junctions with different hop-distance can carry distinct traffic information which should be exploited separately but existing multi-layer GNNs are incompetent to discriminate between their impact. Again, to capture the temporal interrelationship, recurrent neural networks are common in state-of-the-art approaches that often fail to capture long-range dependencies. Furthermore, traffic data shows repeated patterns in a daily or weekly period which should be addressed explicitly. To address these limitations, we have designed a Simplified Spatio-temporal Traffic forecasting GNN (SST-GNN) that effectively encodes the spatial dependency by separately aggregating different neighborhood representations rather than with multiple layers and capture the temporal dependency with a simple yet effective weighted spatio-temporal aggregation mechanism. We capture the periodic traffic patterns by using a novel position encoding scheme with historical and current data in two different models. With extensive experimental analysis, we have shown that our model has significantly outperformed the state-of-the-art models on three real-world traffic datasets from the Performance Measurement System (PeMS).
Inter-timestamp edges are introduced between identical nodes of consecutive timestamps e.g. an edge between a blue node at timestamp 09:05 AM and a blue node at timestamp 09:10 AM where the same color indicates identical nodes. Although both historical and current-day model deals with the same spatio-temporal graph consisting of all timestamp graphs over 5 min interval in the past hour of the prediction window, the historical model considers traffic features from last week to capture the repeated daily patterns while the current-day model uses only current day (e.g. Tuesday) information to find current day patterns in traffic data. Spatial dependency is captured through aggregating features from different neighborhoods on each timestamp graph while temporal dependency is preserved by performing temporal aggregation among the node representations learned from previous timestamps which are depicted in the Figure above. Finally, concatenation followed by weighted transformation is performed to compute the spatio-temporal embeddings of nodes which are used for traffic prediction.
Spatio-Temporal Aggregation Scheme: To capture complex spatio-temporal dependencies in traffic networks, the historical model concatenates the spatial embeddings from different hop neighborhoods at timestamp t with temporal embedding ZฬH < t > - the weighted aggregation of (ZH< 1 >, . . . ,ZH < t-1 > ), to learn spatio-temporal embeddings ZH< t >. Similarly, current-day model performs the same process.
Clone the git project:
$ git clone https://github.com/AmitRoy7781/SST-GNN
Create a new conda Environment and install required packages (Commands are for ubuntu 16.04)
$ conda create -n TrafficEnv python=3.7
$ conda activate TrafficEnv
$ pip install -r requirements.txt
Main Parameters:
--dataset The input traffic dataset(default:PeMSD7)
--GNN_layers Number of layers in GNN(default:3)
--num_timestamps Number of timestamps in Historical and current model(default:12)
--pred_len Traffic Prediction after how many timestamps(default:3)
--epochs Number of epochs during training(default:200)
--seed Random seed. (default: 42)
--cuda Use GPU if declared
--save_model Save model if declared
--trained_model Run pretrained model if declaired
Train Model Using:
$ python3 sst_gnn.py --cuda --dataset PeMSD7 --pred_len 3 --save_model
Run Trained Model:
Please download the trained SSTGNN models from Google drive and place it in saved_model/PeMSD7
folder
$ python3 sst_gnn.py --cuda --dataset PeMSD7 --pred_len 3 --trained_model
If you find our paper or repo useful then please cite our paper:
@inproceedings{roy2021sst,
title={SST-GNN: simplified spatio-temporal traffic forecasting model using graph neural network},
author={Roy, Amit and Roy, Kashob Kumar and Ahsan Ali, Amin and Amin, M Ashraful and Rahman, AKM Mahbubur},
booktitle={Advances in Knowledge Discovery and Data Mining: 25th Pacific-Asia Conference, PAKDD 2021, Virtual Event, May 11--14, 2021, Proceedings, Part III},
pages={90--102},
year={2021},
organization={Springer}
}