Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

style: adding progress bar to llm-based evaluators #7726

Merged
merged 7 commits into from
May 23, 2024

Conversation

davidsbatista
Copy link
Contributor

@davidsbatista davidsbatista commented May 22, 2024

Proposed Changes:

This adds an optional progress_bar to the run() method of the base LLMEvaluator class and its dependents. Depending on the dataset, a faithfulness or context relevance evaluation can take several minutes, and the user can opt to be informed of ongoing progress.

@davidsbatista davidsbatista added the ignore-for-release-notes PRs with this flag won't be included in the release notes. label May 22, 2024
@coveralls
Copy link
Collaborator

coveralls commented May 22, 2024

Pull Request Test Coverage Report for Build 9194623363

Warning: This coverage report may be inaccurate.

This pull request's base commit is no longer the HEAD commit of its target branch. This means it includes changes from outside the original pull request, including, potentially, unrelated coverage changes.

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage increased (+0.002%) to 90.555%

Totals Coverage Status
Change from base Build 9176174231: 0.002%
Covered Lines: 6587
Relevant Lines: 7274

💛 - Coveralls

@davidsbatista davidsbatista marked this pull request as ready for review May 22, 2024 15:07
@davidsbatista davidsbatista requested a review from a team as a code owner May 22, 2024 15:07
@davidsbatista davidsbatista requested review from silvanocerza, shadeMe and julian-risch and removed request for a team and silvanocerza May 22, 2024 15:07
@github-actions github-actions bot added the type:documentation Improvements on the docs label May 22, 2024
@davidsbatista davidsbatista merged commit a4fc2b6 into main May 23, 2024
22 checks passed
@davidsbatista davidsbatista deleted the add-progress-bar-llm-evaluators branch May 23, 2024 07:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ignore-for-release-notes PRs with this flag won't be included in the release notes. topic:tests type:documentation Improvements on the docs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants