Skip to content

IdentityChain v0.0.1

Choose a tag to compare

@marcusm117 marcusm117 released this 10 Oct 10:18
· 3 commits to main since this release

What's in v0.0.1?

You can create an IdentityChain object to evaluate the Self-Consistency, NL-to-PL Accuracy, and PL-to-NL Accuracy of your own Code LLMs on two benchmarks: HumanEvalPlus and MBPP.

Full Changelog: https://github.com/marcusm117/IdentityChain/commits/v0.0.1

What's next?

We plan to support more evaluation benchmarks and more programming languages