Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Serving][Benchmark] Add benchmark code for serving #69

Closed
wants to merge 43 commits into from
Closed

[Serving][Benchmark] Add benchmark code for serving #69

wants to merge 43 commits into from

Commits on Jan 19, 2024

  1. add benchmarks

    @xwu99
    xwu99 committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    2f4dc20 View commit details
    Browse the repository at this point in the history

  2. update

    @xwu99
    xwu99 committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    d1a048d View commit details
    Browse the repository at this point in the history

  3. update

    @xwu99
    xwu99 committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    da03432 View commit details
    Browse the repository at this point in the history

Commits on Jan 22, 2024

  1. update

    @xwu99
    xwu99 committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    5a4a28c View commit details
    Browse the repository at this point in the history

  2. update

    @xwu99
    xwu99 committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    06b5ea0 View commit details
    Browse the repository at this point in the history

  3. update

    @xwu99
    xwu99 committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    765da83 View commit details
    Browse the repository at this point in the history

  4. update

    @xwu99
    xwu99 committed Jan 22, 2024
    Configuration menu
    Copy the full SHA
    d534f76 View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. move README to doc/benchmark.md

    @xwu99
    xwu99 committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    eab0425 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. fix error & add progress bar

    @KepingYan
    KepingYan committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    cf4f071 View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2024

  1. update

    @xwu99
    xwu99 committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    6285ae9 View commit details
    Browse the repository at this point in the history

  2. update doc

    @xwu99
    xwu99 committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    ff6c4cb View commit details
    Browse the repository at this point in the history

  3. update

    @xwu99
    xwu99 committed Feb 18, 2024
    Configuration menu
    Copy the full SHA
    12c3bd3 View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. add support for ipex dataset

    @xwu99
    xwu99 committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    64e16cd View commit details
    Browse the repository at this point in the history

  2. update 

    Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com>
    @xwu99
    xwu99 committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    348394a View commit details
    Browse the repository at this point in the history

  3. update 

    Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com>
    @xwu99
    xwu99 committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    c73af8f View commit details
    Browse the repository at this point in the history

  4. update

    @xwu99
    xwu99 committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    f3a64a9 View commit details
    Browse the repository at this point in the history

  5. add doc

    @xwu99
    xwu99 committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    06e4142 View commit details
    Browse the repository at this point in the history

Commits on Feb 26, 2024

  1. TODO: fix stats

    @xwu99
    xwu99 committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    d87854f View commit details
    Browse the repository at this point in the history

  2. TODO: fix stats

    @xwu99
    xwu99 committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    02a2a48 View commit details
    Browse the repository at this point in the history

Commits on Feb 27, 2024

  1. Add track-token-latency, track-input-output, results-dir

    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    1c32952 View commit details
    Browse the repository at this point in the history

  2. update doc

    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    fa328aa View commit details
    Browse the repository at this point in the history

  3. update doc

    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    82d646a View commit details
    Browse the repository at this point in the history

  4. update 

    Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com>
    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    79c45d5 View commit details
    Browse the repository at this point in the history

  5. update code

    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    05d47ca View commit details
    Browse the repository at this point in the history

  6. update 

    Signed-off-by: Wu, Xiaochang <xiaochang.wu@intel.com>
    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    4197444 View commit details
    Browse the repository at this point in the history

  7. add sample_requests_from_random_generation

    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    bbdb393 View commit details
    Browse the repository at this point in the history

  8. update

    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    d0b5659 View commit details
    Browse the repository at this point in the history

  9. update

    @xwu99
    xwu99 committed Feb 27, 2024
    Configuration menu
    Copy the full SHA
    621b1f1 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2024

  1. update

    @xwu99
    xwu99 committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    35a66ad View commit details
    Browse the repository at this point in the history

  2. update

    @xwu99
    xwu99 committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    0a30e61 View commit details
    Browse the repository at this point in the history

  3. update

    @xwu99
    xwu99 committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    d2a7d59 View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2024

  1. fix max_new_tokens bug, fix output_len, add param model_type for inpu… 

    …t prompt
    @KepingYan
    KepingYan committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    f2f5fb7 View commit details
    Browse the repository at this point in the history

  2. revert

    @KepingYan
    KepingYan committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    1211d84 View commit details
    Browse the repository at this point in the history

  3. resubmit

    @KepingYan
    KepingYan committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    c76d6da View commit details
    Browse the repository at this point in the history

  4. fix test

    @KepingYan
    KepingYan committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    1b462cb View commit details
    Browse the repository at this point in the history

Commits on Mar 11, 2024

  1. add length limit and fix index out of range

    @KepingYan
    KepingYan committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    5d1a329 View commit details
    Browse the repository at this point in the history

  2. merge main branch

    @KepingYan
    KepingYan committed Mar 11, 2024
    Configuration menu
    Copy the full SHA
    4c49f57 View commit details
    Browse the repository at this point in the history

Commits on Mar 13, 2024

  1. fix conflict

    @KepingYan
    KepingYan committed Mar 13, 2024
    Configuration menu
    Copy the full SHA
    f704f92 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2024

  1. merge upstream

    @xwu99
    xwu99 committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    c29d982 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. Merge branch 'intel:main' into add-benchmark-serving

    @xwu99
    xwu99 committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    71586f8 View commit details
    Browse the repository at this point in the history

  2. add openai support

    @KepingYan
    KepingYan committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    5f0f1f6 View commit details
    Browse the repository at this point in the history

  3. Refactor get_request to support batching

    @xwu99
    xwu99 committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    71d8a3e View commit details
    Browse the repository at this point in the history

  4. Refactor get_request to support batching

    @xwu99
    xwu99 committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    97bc73f View commit details
    Browse the repository at this point in the history