2.6.4

2.6.4 (2026-01-03)

Fix

• fix: Add leaderboard docker workflow (#3828)

• Add GitHub workflow to test leaderboard Dockerfile

• Add .github/workflows/leaderboard_docker.yml workflow that:
  • Builds the Docker image
  • Tests container startup with 6-minute timeout
  • Monitors for container exit codes and failures
  • Shows progress updates during long initialization
  • Validates leaderboard dependencies are available
• Include Dockerfile for leaderboard containerization
• Fix missing typer dependency in leaderboard extras to resolve ModuleNotFoundError
• Update uv.lock with typer dependency

🤖 Generated with Claude Code

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>

• Optimize leaderboard Docker workflow with smart exit conditions

• Add intelligent startup progress detection instead of blind 5.5min wait
• Monitor key milestones: app startup, Step 1/7 completion
• Only exit early on actual completion signals (Gradio server ready, full initialization)
• Hard timeout failure at 5.5min regardless of progress
• Improved logging with 30s progress updates
• Tested with act: reduces wait time from 5.5min to ~2.5min when appropriate

🤖 Generated with Claude Code

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>

• Remove redundant Test container dependencies step

• Dependencies already verified during Docker build process
• Runtime verification handled by smart exit conditions
• Eliminates environment-specific import failures in act testing
• Streamlines workflow to focus on essential container startup validation

🤖 Generated with Claude Code

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>

• Fix Docker image availability and add GHCR caching

• Add load: true to ensure built image is available for docker run
• Add GHCR login and push for enhanced caching across workflow runs
• Include commit-specific and latest tags for better cache utilization

🤖 Generated with Claude Code

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>

• Fix Docker Hub push error by separating GHCR push from local testing

• Only push to GHCR to avoid Docker Hub authentication issues
• Pull GHCR image and tag locally for testing
• Maintains same local tag name for test step compatibility

🤖 Generated with Claude Code

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>

• Add free disk space step to prevent storage errors

• Remove unused software installations (~10GB)
• Clean Docker cache before build operations
• Prevents "no space left on device" errors during image pull

🤖 Generated with Claude Code

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>

• Fix duplicate detection messages and improve server response validation

• Add INIT_COMPLETE_DETECTED state tracking to prevent repeated "initialization complete" messages
• Remove Step 1/7 detection logic that was causing duplicate output
• Add server response test after initialization complete detection
• Clean up progress status display and exit conditions

🤖 Generated with Claude Code

Co-Authored-By: Claude Sonnet 4 <noreply@anthropic.com>

• fix: remove redundant typer dependency from leaderboard extras

• fix: only push Docker images from main branch

• fix: use COPY instead of git clone in Dockerfile

---

Co-authored-by: Claude Sonnet 4 <noreply@anthropic.com> (c7c04e5)