Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix/bug fixes langtest 2 1 0 rc1 #1003

Merged
merged 7 commits into from
Apr 2, 2024

Conversation

chakravarthik27
Copy link
Collaborator

@chakravarthik27 chakravarthik27 commented Apr 1, 2024

This pull request addresses several bugs:

Documentation:

  • Updated paths: Image and URL paths in the README.md file have been corrected to ensure proper linking.

Multi-model Support:

  • Default value: A default value of False has been added for the __is_multi_model variable in the Harness class to handle multi-model scenarios.
  • Test cases: Edited test cases have been added for both multi-dataset and single-dataset configurations. Comments have been included in the imported test cases for clarity in the single-dataset case.

Other Fixes:

  • Dataset name fix: The dataset_name variable in datasource.py has been fixed to reflect its correct usage.
  • Default folder: The default .langtest folder path has been corrected in the UserProfile Path.
  • Typo fix: A typo in the get_embedding method call has been rectified.
  • Summarization: A server_prompt parameter has been added to the run method for the summarization task.

@chakravarthik27 chakravarthik27 requested review from Prikshit7766 and ArshaanNazir and removed request for Prikshit7766 April 2, 2024 05:55
@chakravarthik27 chakravarthik27 added the 🐛 Bug Something isn't working label Apr 2, 2024
@chakravarthik27 chakravarthik27 merged commit a6350e9 into release/2.0.1 Apr 2, 2024
3 checks passed
@chakravarthik27 chakravarthik27 self-assigned this May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 Bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants