Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

restructure aggregation of InstanceMetric , enabling to expand grouping and filtering option on to GlobalMetric #752

Closed
wants to merge 12 commits into from
Closed

restructure aggregation of InstanceMetric , enabling to expand grouping and filtering option on to GlobalMetric #752

wants to merge 12 commits into from

Commits on May 12, 2024

  1. save work in progress for further dev 

    Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    b7a541e View commit details
    Browse the repository at this point in the history

  2. restructure aggregation of InstanceMetric to independent components 

    Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    e8b957c View commit details
    Browse the repository at this point in the history

  3. further componentized grouping, filtering and control-comparison, and… 

    … moved to MetricWithConfidence on the way to expand to global

Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    e79e002 View commit details
    Browse the repository at this point in the history

  4. Expand grouping on to global metrics 

    Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    3da94a2 View commit details
    Browse the repository at this point in the history

  5. grouped ci for GlobalMetric 

    Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    9aa03fa View commit details
    Browse the repository at this point in the history

  6. run ci for global metric also with ci_scores is None for backward com… 

    …patibility

Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    a45e3de View commit details
    Browse the repository at this point in the history

  7. tuned CI to run grouped evaluation when non fixed 

    Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    b63aed6 View commit details
    Browse the repository at this point in the history

  8. for scores that are lists, like rouge with use_aggregator=False, conc… 

    …atenate when combining groups' scores

Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    58bfbad View commit details
    Browse the repository at this point in the history

  9. grouped and filtered for rougeL 

    Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    1c05e95 View commit details
    Browse the repository at this point in the history

  10. bulkinstance too 

    Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    442a4c1 View commit details
    Browse the repository at this point in the history

  11. simplified further more by decouple aggregating_function_name from ag… 

    …gregating_function

Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    a5b0aca View commit details
    Browse the repository at this point in the history

  12. advance to shape score aggregations into operators 

    Signed-off-by: dafnapension <dafnashein@yahoo.com>
    @dafnapension
    dafnapension committed May 12, 2024
    Configuration menu
    Copy the full SHA
    eb7f439 View commit details
    Browse the repository at this point in the history