GithubHelp home page GithubHelp logo

dongqifu / vcr-graphormer Goto Github PK

View Code? Open in Web Editor NEW
6.0 2.0 0.0 24.73 MB

VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connections, ICLR 2024

Python 100.00%
attention-mechanism graph-neural-network graph-transformer neural-network transformer

vcr-graphormer's Introduction

VCR-Graphormer: A Mini-batch Graph Transformer via Virtual Connections, ICLR 2024

https://arxiv.org/pdf/2403.16030

pic

How to run

  1. Place datasets into "dataset" folder

    • Reddit, Aminer, and Amazon2M are here, they can also be traced from the original source here.
    • Squirrel and Actor are here, they can also be traced from the DGL.
    • Other datasets are built in the library and can be directly accessed through our code.
  2. Commands are in "demo.txt"

  3. Dependencies are in "environment.yml". Major libraries are below.

    • dgl == 0.9.1
    • torch == 2.0.1
    • torch-geometric == 2.3.1
    • torch-scatter == 2.1.1
    • torch-sparse == 0.6.17

Codebase Acknowledgment

  1. NAGphormer: A Tokenized Graph Transformer for Node Classification in Large Graphs
  2. Influence-Based Mini-Batching for Graph Neural Networks
  3. GRAND+: Scalable Graph Random Neural Networks
  4. Large Scale Learning on Non-Homophilous Graphs: New Benchmarks and Strong Simple Methods

vcr-graphormer's People

Contributors

dongqifu avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

vcr-graphormer's Issues

Some detailed questions

Hello, your work is interesting and inspires me a lot!
But recently when running your code in this project, I am a bit confused.
When I directly execute commands you provided in demo.txt, there is a decrease in performance compared to the results in your paper, especially in the PubMed, CoraFull, and Computer datasets.
May I ask if there are some other training tricks, or can you provide commands with better hyperparameters in demo.txt for achieving performance in your paper? Thanks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.