Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Run the benchmark suite with dynamic batch only #97912

Closed
wants to merge 3 commits into from
Closed

Run the benchmark suite with dynamic batch only #97912

wants to merge 3 commits into from

Commits on Mar 29, 2023

  1. Run the benchmark suite with dynamic batch only 

    Signed-off-by: Edward Z. Yang <ezyang@meta.com>

[ghstack-poisoned]
    @ezyang
    ezyang committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    ee4e791 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. Update on "Run the benchmark suite with dynamic batch only" 

    Symbolic shapes compile time on full CI with inductor is horribly long (even though our aot_eager local runs seemed to suggest that the added latency was only 10s per model.) To patch over the problem for now, run the benchmark suite with dynamic batch only.  This should absolve a lot of sins.

Signed-off-by: Edward Z. Yang <ezyangmeta.com>

cc soumith voznesenskym penguinwu anijain2305 EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng Xia-Weiwen wenzhe-nrv jiayisunx desertfire

[ghstack-poisoned]
    @ezyang
    ezyang committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    fea5fc5 View commit details
    Browse the repository at this point in the history

  2. Update on "Run the benchmark suite with dynamic batch only" 

    Symbolic shapes compile time on full CI with inductor is horribly long (even though our aot_eager local runs seemed to suggest that the added latency was only 10s per model.) To patch over the problem for now, run the benchmark suite with dynamic batch only.  This should absolve a lot of sins.

Signed-off-by: Edward Z. Yang <ezyangmeta.com>

cc soumith voznesenskym penguinwu anijain2305 EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng Xia-Weiwen wenzhe-nrv jiayisunx desertfire

[ghstack-poisoned]
    @ezyang
    ezyang committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    12c6bbb View commit details
    Browse the repository at this point in the history