Skip to content

Releases: NBChub/chatBGC_benchmark

v0.2.2

Choose a tag to compare

@matinnuhamunada matinnuhamunada released this 28 Aug 14:21

This release improves benchmark visualization and evaluation

Full Changelog: v0.2.1...v0.2.2

v0.2.1

Choose a tag to compare

@matinnuhamunada matinnuhamunada released this 15 Aug 11:51

This release add refined prompt to the question, explaining that all antiSMASH table have antismash. as the prefix before table name.

Full Changelog: v0.2.0...v0.2.1

v0.2.0

Choose a tag to compare

@matinnuhamunada matinnuhamunada released this 15 Aug 08:20

This release improves the training dataset, questions, and testing schema.

Full Changelog: v0.1.2...v0.2.0

v0.1.2

Choose a tag to compare

@matinnuhamunada matinnuhamunada released this 12 Aug 14:54

This release restructure the output folder so that the vector database can be reused for different benchmarking versions.

Full Changelog: v0.1.1...v0.1.2

v0.1.1

Choose a tag to compare

@matinnuhamunada matinnuhamunada released this 12 Aug 14:27
  • This release track ChatBGC version and also the repository version.
  • Add script for gpt-4o-mini

Full Changelog: v0.1.0...v0.1.1

v0.1.0

Choose a tag to compare

@matinnuhamunada matinnuhamunada released this 12 Aug 14:08

This is the first release of the ChatBGC benchmarking effort, comparing three different foundational models.

Full Changelog: https://github.com/NBChub/chatBGC_benchmark/commits/v0.1.0