Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Promptfoo Integration Updates #640

Merged
merged 9 commits into from
Mar 16, 2024
Merged

Promptfoo Integration Updates #640

merged 9 commits into from
Mar 16, 2024

Commits on Mar 15, 2024

  1. added class EvalPromptfoo

    @shrjain1312
    shrjain1312 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    375d282 View commit details
    Browse the repository at this point in the history

  2. Add eval_model to EvalPromptfoo

    @Dominastorm
    Dominastorm committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    8142fc3 View commit details
    Browse the repository at this point in the history

  3. Added project_name for uptrain evals to avoid multiple dashboards

    @shrjain1312
    shrjain1312 committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    4bf07fd View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2024

  1. 1. better handling of ports 

    2. added project name
3. port closes at keyboard interrupt
4. add method to install
5. add method to run custom promptfoo command
6. better handling of promptfoo version
    @shrjain1312
    shrjain1312 committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    2438d5c View commit details
    Browse the repository at this point in the history

  2. updated notebook

    @shrjain1312
    shrjain1312 committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    9dfad7e View commit details
    Browse the repository at this point in the history

  3. minor changes in notebook

    @shrjain1312
    shrjain1312 committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    9549414 View commit details
    Browse the repository at this point in the history

  4. minor edits in notebook

    @shrjain1312
    shrjain1312 committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    4b59c07 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into promptfoo

    @Dominastorm
    Dominastorm committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    3afb6f9 View commit details
    Browse the repository at this point in the history

  6. Run black

    @Dominastorm
    Dominastorm committed Mar 16, 2024
    Configuration menu
    Copy the full SHA
    c4d5a00 View commit details
    Browse the repository at this point in the history