Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Example][Refactor] Refactor GAT example #4240

Merged
merged 9 commits into from
Jul 22, 2022

Conversation

chang-l
Copy link
Collaborator

@chang-l chang-l commented Jul 11, 2022

Description

Referring to: #4186, this PR is for refactoring GAT example. Only single GPU is implemented.

Checklist

Please feel free to remove inapplicable items for your PR.

  • The PR title starts with [$CATEGORY] (such as [NN], [Model], [Doc], [Feature]])
  • Changes are complete (i.e. I finished coding on this PR)
  • All changes have test coverage
  • Code is well-documented
  • To the best of my knowledge, examples are either not affected by this change,
    or have been fixed to be compatible with this change
  • Related issue is referred in this PR
  • If the PR is for a new model/paper, I've updated the example index here.

Changes

  • Removed all cmd options except --dataset, while using their default values
  • Self-contained (removed utils.py and gat.py and put them in same file)
  • Aligned to other golden examples (gcn/graphsage)
  • Removed train_ppi.py, i.e., not supporting ppi dataset anymore
  • Reran all examples (citeseer, cora, pubmed) and updated README file

Results

Dataset Test Accuracy in 5 runs (previous) Test Accuracy in 5 runs (this PR)
Cora 0.8220, 0.8050, 0.8100, 0.8320, 0.8230 0.8270, 0.8160, 0.8190, 0.8160, 0.8140
PPI 0.9825, 0.9765, 0.9814, 0.9801, 0.9814 0.9744, 0.9814, 0.9814, 0.9809, 0.9805

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 11, 2022

To trigger regression tests:

  • @dgl-bot run [instance-type] [which tests] [compare-with-branch];
    For example: @dgl-bot run g4dn.4xlarge all dmlc/master or @dgl-bot run c5.9xlarge kernel,api dmlc/master

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 11, 2022

Commit ID: e4a9467

Build ID: 1

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@mufeili mufeili self-requested a review July 11, 2022 07:35
```bash
python3 train_ppi.py --gpu=0
python3 train.py --dataset cora
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why did you drop the support of PPI?

Copy link
Collaborator Author

@chang-l chang-l Jul 18, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was thinking of simplicity.
Added PPI support back in case you think it is necessary (reported 5-rerun results compared to older version in above PR description).

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also as a reminder here, I have removed "early stopping" function in both train.py and train_ppi.py for simplicity. Please let me know if you think if it is necessary and I will add it back.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jermainewang @yzh119 What do you think? Early stopping was added because some users complained about the accuracy.

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 18, 2022

Commit ID: 36b467d

Build ID: 2

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 19, 2022

Commit ID: cab8260

Build ID: 3

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 19, 2022

Commit ID: e958d8a

Build ID: 4

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 20, 2022

Commit ID: 93dd2a7

Build ID: 5

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 20, 2022

Commit ID: 7ac855f

Build ID: 6

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 21, 2022

Commit ID: 8c0f896

Build ID: 7

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 21, 2022

Commit ID: 7cf0fed

Build ID: 8

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 22, 2022

Commit ID: c784fb9b9cd54d86ca018affb1483c73043c6564

Build ID: 9

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Jul 22, 2022

Commit ID: 232b1bb

Build ID: 10

Status: ✅ CI test succeeded

Report path: link

Full logs path: link

@mufeili mufeili merged commit 6e1be69 into dmlc:master Jul 22, 2022
@chang-l chang-l deleted the refactor-gat-example branch July 22, 2022 15:13
BarclayII pushed a commit to BarclayII/dgl that referenced this pull request Aug 10, 2022
* Refactor gat example

* Add ppi support

* Minor update

* Update

* Update

* Change valid_xxx to val_xxx

* Readme Update

* Update

Co-authored-by: Mufei Li <mufeili1996@gmail.com>
@jermainewang jermainewang mentioned this pull request Aug 10, 2022
10 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants