Skip to content
This repository was archived by the owner on Sep 28, 2025. It is now read-only.

v0.4.0 - Resilient Benchmark Workflows

Choose a tag to compare

View all tags
@Goldziher Goldziher released this 04 Jul 15:32
· 160 commits to main since this release
v0.4.0
b7d5623
This commit was signed with the committer’s verified signature.
Goldziher Na'aman Hirschfeld
GPG key ID: 8C3B71B34E1FAAE0
Verified
Learn about vigilant mode.

v0.4.0 - Resilient Benchmark Workflows

🚀 New Features

  • Fault-tolerant benchmark workflows: Pipelines now succeed even when individual frameworks timeout
  • Partial results capture: Successfully completed framework runs are preserved even if others fail
  • GitHub Pages resilience: Always deploys with available data, showing fallback pages when needed

🔧 Improvements

  • Enhanced aggregation: Creates placeholder results when no valid benchmark data exists
  • Better error handling: Graceful degradation for report and visualization generation
  • Improved status reporting: Clear indication of which frameworks succeeded vs failed/timed out

🐛 Bug Fixes

  • Fixed GitHub Pages pipeline failures due to missing benchmark artifacts
  • Resolved YAML syntax issues in deployment workflows
  • Fixed import errors in report generation steps

📊 Benchmark Impact

This release ensures that fast frameworks (like Kreuzberg) aren't blocked by slow ones (like Docling), providing better visibility into benchmark results even with partial data.

🔗 Links

🤖 Generated with Claude Code

Assets 2
Loading