Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added a simple Testbed tool for repeatedly running templated Autogen scenarios with tightly-controlled initial conditions. #455

Merged
merged 17 commits into from
Nov 4, 2023
Merged

Added a simple Testbed tool for repeatedly running templated Autogen scenarios with tightly-controlled initial conditions. #455

merged 17 commits into from
Nov 4, 2023

Commits on Oct 24, 2023

  1. Initial commit of the autogen testbed environment.

    @afourney
    afourney committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    8b11c39 View commit details
    Browse the repository at this point in the history

  2. Fixed some typos in the Testbed README.md

    @afourney
    afourney committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    ff3c027 View commit details
    Browse the repository at this point in the history

  3. Added some stricter termination logic to the two_agent scenario, and … 

    …swiched the logo task from finding Autogen's logo, to finding Microsoft's (it's easier)
    @afourney
    afourney committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    df27d75 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. Added documentation to testbed code in preparation for PR

    @afourney
    afourney committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    728d831 View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2023

  1. Merge branch 'main' into testbed

    @afourney
    afourney committed Oct 30, 2023
    Configuration menu
    Copy the full SHA
    d2048ad View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Added a variation of HumanEval to the Testbed. It is also a reasonabl… 

    …e example of how to integrate other benchmarks.
    @afourney
    afourney committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    d0ce31b View commit details
    Browse the repository at this point in the history

  2. Removed ChatCompletion.start_logging and related features. Added an e… 

    …xplicit TERMINATE output to HumanEval to save 1 turn in each conversation.
    @afourney
    afourney committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    8b2ea28 View commit details
    Browse the repository at this point in the history

  3. Added metrics utils script for HumanEval

    @afourney
    afourney committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    b0b50ea View commit details
    Browse the repository at this point in the history

  4. Updated the requirements in the README.

    @afourney
    afourney committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    c5b9b1c View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2023

  1. Added documentation for HumanEval csv schemas

    @afourney
    afourney committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    a6d8e4d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into testbed

    @afourney
    afourney authored Nov 3, 2023
    Configuration menu
    Copy the full SHA
    50cad02 View commit details
    Browse the repository at this point in the history

  3. Standardized on how the OAI_CONFIG_LIST is handled.

    @afourney
    afourney committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    3dffbd9 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'testbed' of github.com:microsoft/autogen into testbed

    @afourney
    afourney committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    bfcf83e View commit details
    Browse the repository at this point in the history

  5. Removed dot-slash from 'includes' path for cross-platform compatibility

    @afourney
    afourney committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    771c2da View commit details
    Browse the repository at this point in the history

  6. Missed a file.

    @afourney
    afourney committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    06b4e6c View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2023

  1. Merge branch 'main' into testbed

    @afourney
    afourney authored Nov 4, 2023
    Configuration menu
    Copy the full SHA
    61d4d18 View commit details
    Browse the repository at this point in the history

  2. Updated readme to include known-working versions.

    @afourney
    afourney committed Nov 4, 2023
    Configuration menu
    Copy the full SHA
    09c25c4 View commit details
    Browse the repository at this point in the history