Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Inf2 example #2399

Merged
merged 11 commits into from
Jun 16, 2023
Merged

Inf2 example #2399

merged 11 commits into from
Jun 16, 2023

Commits on Apr 29, 2023

  1. adding inf2 example

    Ubuntu committed Apr 29, 2023
    Configuration menu
    Copy the full SHA
    8189fc9 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. fix the inference func

    @HamidShojanazeri
    HamidShojanazeri committed May 31, 2023
    Configuration menu
    Copy the full SHA
    7460874 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. Add batch size note

    @HamidShojanazeri
    HamidShojanazeri committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    203e37b View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Fix INF2 example handler (#2378) 

    * fix INF2 example handler

* Add logging for padding in inf2 handler

* update response timeout and model

* Update documentation to show opt-6.7b as the example model

* Update model batch log

---------

Co-authored-by: Naman Nandan <namannan@amazon.com>
    @namannandan
    namannandan and Naman Nandan committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    113d22a View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Merge branch 'master' into inf2-example

    @namannandan
    namannandan committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    b1c1418 View commit details
    Browse the repository at this point in the history

  2. Update requirements and sample text file

    Naman Nandan committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    4f6d2f4 View commit details
    Browse the repository at this point in the history

  3. fix neuron core allocation to worker process

    Naman Nandan committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    b849542 View commit details
    Browse the repository at this point in the history

  4. Fix linter errors and update documentation

    Naman Nandan committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    a64938c View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. enable core allocation verification in handler

    Naman Nandan committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    50668c5 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. Merge branch 'master' into inf2-example

    @namannandan
    namannandan committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    64685cb View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. fix lint error

    Naman Nandan committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    e7559e7 View commit details
    Browse the repository at this point in the history