dsl-lab / specformer

Transformer-based Spectral Graph Neural Networks

Specformer

Code of Specformer: Spectral Graph Neural Networks Meet Transformers

How to run

• For node-level task, e.g., signal regression and node classification, you should first run preprocess_node_data.py to generate .pt files for each dataset.
• For graph-level taks, you can direcly run dgl_main.py.

Q&A

Any suggestion/question is welcome.

Reference

If you make advantage of Specformer in your research, please cite the following in your manuscript:

@inproceedings{specformer2023,
  author={Deyu Bo and 
          Chuan Shi and
          Lele Wang and
          Renjie Liao},
  title={Specformer: Spectral Graph Neural Networks Meet Transformers},
  booktitle = {{ICLR}},
  publisher = {OpenReview.net},
  year      = {2023}
}

specformer's Issues

pygdataclass is required, but it is missing in repo

In get_dataset.py

from dataclasses import *
from dgldataclass import DglGraphPropPredDataset, DglPCQM4Mv2Dataset, DglZincDataset
from pygdataclass import PygGraphPropPredDataset

dgldataclass.py exists, but pygdataclass.py does not. It might be issue??

At 950 epochs, the best results on the zinc dataset are still more than 1.4, for a total of just 1,000 epochs

The experiment seems to have lost some code files，such as pygdataclass.py ...And what is returned in the SpecformerZINC model is a tuple with a different y size. But the above are not the most important, I do not know what is the problem, the code in zinc data set about 950 rounds, the effect is not improved at all, could you please provide a complete code?

There is a significant gap compared to the reported ACC of GCN on CiteSeer

I found that some data processing was done during testing on Citeseer, so I tested the performance of GCN on the processed data and obtained an ACC of 84.86 ± 0.14, which is significantly different from the results reported in the article. GCN is set to two layers, with an hidden dim is 512.

Problems in the get_dataset file

from dataclass import *
from pygdataclass import PygGraphPropPredDataset

The custom "pygdataclass" and "pygdataclass" modules are not a standard Python package or library. But I can't find the files for these two modules in the project.

Looking forward to your reply thanks!