Skip to content

[s2s] two stage run_distributed_eval.py #7105

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 58 commits into from
Sep 13, 2020
Merged

[s2s] two stage run_distributed_eval.py #7105

merged 58 commits into from
Sep 13, 2020

Conversation

sshleifer
Copy link
Contributor

@sshleifer sshleifer commented Sep 13, 2020 •
edited
Loading 

python -m torch.distributed.launch --nproc_per_node=2 run_distributed_eval.py --fp16 --bs 16
python cleanup_distributed.py tmp_gen  tmp_gen2

julien-c and others added 30 commits May 7, 2020 13:48
@julien-c
BIG Reorganize examples (#4213)
f98ef14 
* Created using Colaboratory

* [examples] reorganize files

* remove run_tpu_glue.py as superseded by TPU support in Trainer

* Bugfix: int, not tuple

* move files around
@sshleifer
upstream
3fdaddc
@sshleifer
docs
4ed9067
@sshleifer
Merge remote-tracking branch 'upstream/master'
84b5e23
@sshleifer
Merge remote-tracking branch 'upstream/master'
4d2e6ee
@sshleifer
boom boom
94de64b
@sshleifer
Merge remote-tracking branch 'upstream/master'
5775d7b
@sshleifer
Merge branch 'master' of github.com:sshleifer/transformers_fork
784333e
@sshleifer
Merge remote-tracking branch 'upstream/master'
71a6716
@sshleifer
Merge remote-tracking branch 'upstream/master'
3283f08
@sshleifer
Merge remote-tracking branch 'upstream/master'
219b91e
@sshleifer
Merge remote-tracking branch 'upstream/master'
97db343
@sshleifer
Merge remote-tracking branch 'upstream/master'
1d47552
@sshleifer
Merge remote-tracking branch 'upstream/master'
3c9e56e
@sshleifer
Merge remote-tracking branch 'upstream/master'
6e8244d
@sshleifer
Merge remote-tracking branch 'upstream/master'
7d26cbc
@sshleifer
Merge remote-tracking branch 'upstream/master'
efc3817
@sshleifer
boom boom
bbfc09b
@sshleifer
boom boom
dbbbe38
@sshleifer
boom boom
3250876
@sshleifer
boom boom
85ddccb
@sshleifer
boom boom
b003026
@sshleifer
boom boom
c31f917
@sshleifer
boom boom
cf6ceed
@sshleifer
boom boom
d59f3cb
@sshleifer
boom boom
9590a01
@sshleifer
boom boom
186021c
@sshleifer
boom boom
854f4db
@sshleifer
boom boom
6f534e4
@sshleifer
boom boom
9189d68
@sshleifer sshleifer changed the title [wip] try distributed run_eval.py two stage distributed run_eval.py Sep 13, 2020
@sshleifer sshleifer marked this pull request as ready for review September 13, 2020 21:07
@sshleifer sshleifer mentioned this pull request Sep 13, 2020
Closed
@sshleifer sshleifer linked an issue Sep 13, 2020 that may be closed by this pull request
[help] Add multigpu evalulation script for seq2seq #6785
Closed
@sshleifer sshleifer changed the title two stage distributed run_eval.py [s2s] two stage run_distributed_eval.py Sep 13, 2020
@sshleifer sshleifer merged commit e7f8d2a into master Sep 13, 2020
@sshleifer sshleifer deleted the distro-cut branch September 13, 2020 21:28
Zigur pushed a commit to Zigur/transformers that referenced this pull request Oct 26, 2020
@sshleifer @Zigur
[s2s] two stage run_distributed_eval.py (huggingface#7105)
cfae2d0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[help] Add multigpu evalulation script for seq2seq

2 participants

@sshleifer @julien-c