Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Berkeley-Function-Calling-Leaderboard] Refactor leaderboard result generation and checking #223

Merged
merged 23 commits into from
Mar 5, 2024
Merged

[Berkeley-Function-Calling-Leaderboard] Refactor leaderboard result generation and checking #223

merged 23 commits into from
Mar 5, 2024

Commits on Mar 1, 2024

  1. refurbrish leaderboard script 

    fix

fix

fix readme
    @Fanjia-Yan
    Fanjia-Yan committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    b10df2f View commit details
    Browse the repository at this point in the history

  2. remove artifacts

    @CharlieJCJ
    CharlieJCJ committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    ee3d181 View commit details
    Browse the repository at this point in the history

  3. minor edits on BFCL readme

    @CharlieJCJ
    CharlieJCJ committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    2117766 View commit details
    Browse the repository at this point in the history

  4. modified eval_data_compilation.py usage intro

    @CharlieJCJ
    CharlieJCJ committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    940a40a View commit details
    Browse the repository at this point in the history

  5. add instructions, and messages

    @CharlieJCJ
    CharlieJCJ committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    ce4b13b View commit details
    Browse the repository at this point in the history

  6. fix rest eval

    @Fanjia-Yan
    Fanjia-Yan committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    baa540a View commit details
    Browse the repository at this point in the history

  7. add more instructions

    @CharlieJCJ
    CharlieJCJ committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    57beaa8 View commit details
    Browse the repository at this point in the history

  8. fixed gorilla-v2

    @CharlieJCJ
    CharlieJCJ committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    6f80abd View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2024

  1. add UI, error handling, README

    @CharlieJCJ
    CharlieJCJ committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    64b6917 View commit details
    Browse the repository at this point in the history

  2. add support for of-v0

    @Fanjia-Yan
    Fanjia-Yan committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    61259d4 View commit details
    Browse the repository at this point in the history

  3. vllm edition

    @Fanjia-Yan
    Fanjia-Yan committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    67dea34 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. trial run vllm

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    262327b View commit details
    Browse the repository at this point in the history

  2. System message for OSS model

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    9107a0d View commit details
    Browse the repository at this point in the history

  3. Modify system prompt to hugginface format

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    73ab21b View commit details
    Browse the repository at this point in the history

  4. Update openfunctions_executable_checker.py

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    8afa4e1 View commit details
    Browse the repository at this point in the history

  5. Update README.md

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    75bcad0 View commit details
    Browse the repository at this point in the history

  6. fix input file None blocking issue

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    1151688 View commit details
    Browse the repository at this point in the history

  7. add requirements.txt

    @CharlieJCJ
    CharlieJCJ committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    1cfbe33 View commit details
    Browse the repository at this point in the history

  8. ping mistralai

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    f36baf9 View commit details
    Browse the repository at this point in the history

  9. Update README on mistral

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    3bbce81 View commit details
    Browse the repository at this point in the history

  10. unenforce vllm requirement

    @Fanjia-Yan
    Fanjia-Yan committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    cd85560 View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2024

  1. working script late night

    @CharlieJCJ
    CharlieJCJ committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    3e1e31d View commit details
    Browse the repository at this point in the history

  2. [add] oss model eval support, try except for firefunctions

    @CharlieJCJ
    CharlieJCJ committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    dfa62f1 View commit details
    Browse the repository at this point in the history