Skip to content

v1.0.1

Choose a tag to compare

@Yoosu-L Yoosu-L released this 04 Dec 02:00
· 40 commits to main since this release

Release Highlights

🚀 Performance Measurement Improvements

This release addresses a critical challenge in API performance benchmarking by introducing dynamic prompt generation to mitigate potential caching effects.

Key Enhancements

  1. Randomized Prompt Generation
    • Introduced a mechanism to generate input prompts of arbitrary lengths
    • Prevents artificial inflation of prompt throughput metrics caused by caching
    • Ensures more accurate and realistic performance measurements
  2. Binary Optimization
    • Significantly reduced executable file size
    • Maintains full functionality of the previous release

Changelog

  • ✅ Added arbitrary length of dynamic prompt generation
  • ✅ Reduced executable file size