Skip to content

v1.1

Latest

Choose a tag to compare

@UltraEval UltraEval released this 06 Jan 11:14
· 57 commits to main since this release
  • Popular model replication: Added replication support for popular models, including replication result showcases and one-click replication commands (see replication/).
  • Isolated Runtime: Introduced an isolated inference mechanism. Model-specific dependencies are installed/managed automatically; inference runs in the isolated environment and communicates with the main evaluation process via IPC, eliminating dependency conflicts.
  • Specialized model evaluation support: Added specialized audio models for TTS, ASR, and Audio Codec, further expanding evaluation coverage.