Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update master #1

Merged
merged 3 commits into from
Aug 21, 2020
Merged

Update master #1

merged 3 commits into from
Aug 21, 2020

Conversation

barry-jin
Copy link
Owner

Description

(Brief description on what this PR is about)

Checklist

Essentials

  • PR's title starts with a category (e.g. [BUGFIX], [MODEL], [TUTORIAL], [FEATURE], [DOC], etc)
  • Changes are complete (i.e. I finished coding on this PR)
  • All changes have test coverage
  • Code is well-documented

Changes

  • Feature1, tests, (and when applicable, API doc)
  • Feature2, tests, (and when applicable, API doc)

Comments

  • If this change is a backward incompatible change, why must this change be made.
  • Interesting edge cases to note here

cc @dmlc/gluon-nlp-team

sxjscience and others added 3 commits August 14, 2020 17:18
@sxjscience @zheyuye
[Numpy] Benchmark the backbone models + Some fixes + Always use pytho…
32e87d4 
…n3 + Fix conversion tool (#1292)

* update

update

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Create requirements.txt

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update requirements.txt

update

Update README.md

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

Update benchmark_hf.py

fix

fix

Update test_models_bart.py

Update test_models_bart.py

Update bart.py

update

Update __init__.py

Update electra.py

update

update

Update convert_bert_from_tf_hub.sh

update

Update unittests.yml

fix conversion

update

fix bert conversion

update

fix

fix

Update __init__.py

fix bug

fix css

Update benchmark_utils.py

Update benchmark_utils.py

update

update

Update misc.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

no multiprocessing

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

fix bug

Update benchmark_utils.py

Update benchmark_utils.py

try to use mxnet profiler

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

fix

update

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

fix

Update benchmark_utils.py

Update bart.py

Update bart.py

fix

fix

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_gluonnlp.py

Update benchmark_gluonnlp.py

Update benchmark_gluonnlp.py

Update benchmark_utils.py

Update benchmark_utils.py

Update benchmark_utils.py

Update README.md

* Update benchmark_utils.py

* Update benchmark_utils.py

* Update requirements.txt

* Update benchmark_utils.py

* Update benchmark_utils.py

* Update benchmark_utils.py

* Update benchmark_utils.py

* Update benchmark_utils.py

* Update benchmark_utils.py

* debug

* Update benchmark_utils.py

* Update benchmark_gluonnlp.py

* Update benchmark_gluonnlp.py

* Update benchmark_utils.py

* Update pretraining_utils.py

* Update benchmark_utils.py

* update

* Update benchmark_utils.py

* Update benchmark_utils.py

* fix convert

* tiny fix

* python3

* fix

* lower tolerance for albert large and xlarge

* Update benchmark_utils.py

* fix xlmr

* lower tolerance for albert large

* update

* Update benchmark_utils.py

* Update benchmark_utils.py

* Update benchmark_utils.py

* Update benchmark_utils.py

* fix

* Squashed commit of the following:

commit bd05969
Author: ZheyuYe <zheyu.ye1995@gmail.com>
Date:   Tue Aug 11 23:44:53 2020 +0800

    lower tolerance for albert large

commit f0f9cd6
Author: ZheyuYe <zheyu.ye1995@gmail.com>
Date:   Tue Aug 11 14:59:06 2020 +0800

    fix xlmr

commit edd6655
Author: ZheyuYe <zheyu.ye1995@gmail.com>
Date:   Tue Aug 11 14:49:36 2020 +0800

    lower tolerance for albert large and xlarge

commit d651730
Author: ZheyuYe <zheyu.ye1995@gmail.com>
Date:   Tue Aug 11 14:34:55 2020 +0800

    fix

commit e097c3b
Author: ZheyuYe <zheyu.ye1995@gmail.com>
Date:   Tue Aug 11 14:02:13 2020 +0800

    python3

commit d6f3fc4
Author: ZheyuYe <zheyu.ye1995@gmail.com>
Date:   Tue Aug 11 14:00:28 2020 +0800

    tiny fix

commit 93bd659
Author: ZheyuYe <zheyu.ye1995@gmail.com>
Date:   Tue Aug 11 13:08:34 2020 +0800

    fix convert

commit 9238d56
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 21:03:13 2020 -0700

    Update benchmark_utils.py

commit 9bbc581
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 12:58:04 2020 -0700

    Update benchmark_utils.py

commit b1f5955
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 11:18:43 2020 -0700

    update

commit a43e65b
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 10:32:55 2020 -0700

    Update benchmark_utils.py

commit 13db82f
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 10:16:46 2020 -0700

    Update pretraining_utils.py

commit fdd9df5
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 08:49:17 2020 -0700

    Update benchmark_utils.py

commit 44f9c8b
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 05:07:45 2020 -0700

    Update benchmark_gluonnlp.py

commit 45c58b6
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 05:06:05 2020 -0700

    Update benchmark_gluonnlp.py

commit f0ae933
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 05:04:41 2020 -0700

    Update benchmark_utils.py

commit 9735edb
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:59:58 2020 -0700

    debug

commit d9daf58
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:57:17 2020 -0700

    Update benchmark_utils.py

commit 9e0f631
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:56:52 2020 -0700

    Update benchmark_utils.py

commit 37f224f
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:56:06 2020 -0700

    Update benchmark_utils.py

commit 1cf5c7b
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:54:34 2020 -0700

    Update benchmark_utils.py

commit 15272f1
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:49:28 2020 -0700

    Update benchmark_utils.py

commit 8215df6
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:48:20 2020 -0700

    Update benchmark_utils.py

commit 1451f03
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:42:21 2020 -0700

    Update requirements.txt

commit 626739d
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:38:54 2020 -0700

    Update benchmark_utils.py

commit 1955197
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Mon Aug 10 04:31:30 2020 -0700

    Update benchmark_utils.py

commit 2fd7e3b
Author: Xingjian Shi <xshiab@connect.ust.hk>
Date:   Thu Aug 6 23:56:49 2020 -0700

    update

    update

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Create requirements.txt

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update requirements.txt

    update

    Update README.md

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    Update benchmark_hf.py

    fix

    fix

    Update test_models_bart.py

    Update test_models_bart.py

    Update bart.py

    update

    Update __init__.py

    Update electra.py

    update

    update

    Update convert_bert_from_tf_hub.sh

    update

    Update unittests.yml

    fix conversion

    update

    fix bert conversion

    update

    fix

    fix

    Update __init__.py

    fix bug

    fix css

    Update benchmark_utils.py

    Update benchmark_utils.py

    update

    update

    Update misc.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    no multiprocessing

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    fix bug

    Update benchmark_utils.py

    Update benchmark_utils.py

    try to use mxnet profiler

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    fix

    update

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    fix

    Update benchmark_utils.py

    Update bart.py

    Update bart.py

    fix

    fix

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_gluonnlp.py

    Update benchmark_gluonnlp.py

    Update benchmark_gluonnlp.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update benchmark_utils.py

    Update README.md

* fix squad

* fix typo

* Update benchmark_utils.py

* Update benchmark_hf.py

* Update benchmark_gluonnlp.py

* Update benchmark_gluonnlp.py

* Update benchmark_gluonnlp.py

* Update benchmark_utils.py

* Update benchmark_gluonnlp.py

* update

* Update benchmark_gluonnlp.py

* Update benchmark_gluonnlp.py

* Update benchmark_gluonnlp.py

* Update benchmark_gluonnlp.py

* Update README.md

* update

* Update benchmark_hf.py

* Update benchmark_hf.py

* Update requirements.txt

* Update benchmark_hf.py

* Delete conversion_tool_test.yml

* Update README.md

* Update README.md

* Update README.md

* move python --> python3

* try to fix test

* fix test case

* add test cases

* Update README.md

* update

* update logging config

* fix logging config

Co-authored-by: ZheyuYe <zheyu.ye1995@gmail.com>
@hutao965
[FEATURE]Horovod support for training transformer (PART 2) (#1301)
6ae558e 
* set default shuffle=True for boundedbudgetsampler

* fix

* fix log condition

* use horovod to train transformer

* fix

* add mirror wmt dataset

* fix

* rename wmt.txt to wmt.json and remove part of urls

* fix

* tuning params

* use get_repo_url()

* update average checkpoint cli

* paste result of transformer large

* fix

* fix logging in train_transformer

* fix

* fix

* fix

* add transformer base config

* fix

* change to wmt14/full

* print more sacrebleu info

* fix

* add test for num_parts and update behavior of boundedbudgetsampler with even_size

* fix

* fix

* fix

* fix logging when using horovd

* udpate doc of train transformer

* add test case for fail downloading

* add a ShardedIterator

* fix

* fix

* fix

* change mpirun to horovodrun

* make the horovod command complete

* use print(sampler) to cover the codes of __repr__ func

* empty commit

* add test case test_sharded_iterator_even_size

Co-authored-by: Hu <huta@a483e74650ff.ant.amazon.com>
@sxjscience
[Numpy] Fix AWS Batch + Add Docker Support (#1302)
d8b68c6 
* Update submit-job.py

Add LICESE + Examples for batch

Update docker image

update

Update README.md

Update README.md

Update ubuntu18.04-devel.Dockerfile

Update ubuntu18.04-devel.Dockerfile

Update ubuntu18.04-devel.Dockerfile

update

Update ubuntu18.04-devel-gpu.Dockerfile

fix

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update submit-job.py

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

update

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

update

update

Update submit-job.py

Update submit-job.py

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

try to fix

fix batch

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update submit-job.py

Update ubuntu18.04-devel-gpu.Dockerfile

simplify bert test

add files

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

Update ubuntu18.04-devel-gpu.Dockerfile

fix

Update ubuntu18.04-devel-gpu.Dockerfile

* Update ubuntu18.04-devel-gpu.Dockerfile

* try to add back mxnet support

* Update ubuntu18.04-devel-gpu.Dockerfile

* Update ubuntu18.04-devel-gpu.Dockerfile

* update

* Update ubuntu18.04-devel-gpu.Dockerfile

* Update ubuntu18.04-devel-gpu.Dockerfile

* Update ubuntu18.04-devel-gpu.Dockerfile

* fix issues

* update
@barry-jin barry-jin merged commit b45fda2 into barry-jin:master Aug 21, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@barry-jin @sxjscience @hutao965