Repository navigation
IdentityChain v0.0.1
What's in v0.0.1?
You can create an IdentityChain object to evaluate the Self-Consistency, NL-to-PL Accuracy, and PL-to-NL Accuracy of your own Code LLMs on two benchmarks: HumanEvalPlus and MBPP.
Full Changelog: https://github.com/marcusm117/IdentityChain/commits/v0.0.1
What's next?
We plan to support more evaluation benchmarks and more programming languages