Repository navigation
Releases: redhat-et/coding_agent_bench
Releases · redhat-et/coding_agent_bench
Release list
v0.2.8
What's Changed
- Feat/add sre benchmarks by @DanielBlei in #78
- refactor(intake): remove email notifications in favor of the sheet by @hannahsmith-rh in #80
- Sync main into stage by @github-actions[bot] in #77
- 📝 Fix OpenShift service account roles by @taagarwa-rh in #82
- Fix storage endpoint for checkpoint cleanup by @rounakbende10 in #84
- Stage by @taagarwa-rh in #81
Full Changelog: v0.2.7...v0.2.8
v0.2.7
What's Changed
- 👷 Add CICD for deployment to OpenShift by @taagarwa-rh in #64
- 💚 Fix CI by @taagarwa-rh in #66
- 📝 Document adding permission to list secrets by @taagarwa-rh in #69
- 🐛 Remove minio deployment temporarily by @taagarwa-rh in #70
- Stage by @taagarwa-rh in #71
- feat: add run flags and agent-log debugging helper by @DanielBlei in #48
- (feat) add Nebius preemption handling with job pause and resume by @MichaelClifford in #57
- ✨ Migrate from MinIO to RustFS by @taagarwa-rh in #72
- Bump version: 0.2.6 → 0.2.7 by @taagarwa-rh in #75
- Merge remote-tracking branch 'origin' into stage by @taagarwa-rh in #76
- Sync main into stage by @github-actions[bot] in #68
- Stage by @taagarwa-rh in #74
New Contributors
- @DanielBlei made their first contribution in #48
- @github-actions[bot] made their first contribution in #68
Full Changelog: v0.2.6...v0.2.7
v0.2.6
What's Changed
- Fix intake poller so scheduled runs succeed on OpenShift by @hannahsmith-rh in #58
Full Changelog: v0.2.5...v0.2.6
v0.2.5
What's Changed
- 🚸 Add skills field to UI by @taagarwa-rh in #55
- Add RedHatAI/Qwen3.8-27B-INT4 model config by @hannahsmith-rh in #54
Full Changelog: v0.2.4...v0.2.5
v0.2.4
What's Changed
- 🐛 Improve and fix issue with calculate_metrics.py by @taagarwa-rh in #49
- Intake: map Other fields and allow arbitrary datasets by @hannahsmith-rh in #50
- ✨ Add instructions for versioning the project by @taagarwa-rh in #51
- 🐛 Replace mc with awscli by @taagarwa-rh in #52
Full Changelog: v0.2.3...v0.2.4
v0.2.3
What's Changed
- Bump version: 0.2.1 → 0.2.2 by @taagarwa-rh in #45
- ✨ Add b200-sxm-a resource configs by @taagarwa-rh in #46
Full Changelog: v0.2.2...v0.2.3
v0.2.2
What's Changed
- Bump version: 0.2.0 → 0.2.1 by @taagarwa-rh in #41
- Fix Qwen3.8 reasoning effort for Claude Code by @rounakbende10 in #44
- ✨ Add Qwen3.8 27B FP8 by @taagarwa-rh in #43
Full Changelog: v0.2.1...v0.2.2
v0.2.1
What's Changed
- Fix resume endpoint to provision Nebius instances like create_job by @taagarwa-rh in #28
- ✨ Add an API endpoint to list available models by @taagarwa-rh in #30
- Add default retry configuration for transient errors by @rounakbende10 in #29
- ✨ Add job queue UI by @taagarwa-rh in #31
- ✨ Add Qwen3.8 27B by @taagarwa-rh in #32
- Add OpenRouter support via server_url sentinel by @hannahsmith-rh in #34
- 🔥 Remove deprecated harbor envs by @taagarwa-rh in #36
- Add support for skills by @yyualvin in #37
- feat(intake): add benchmark intake poller with manual approval by @hannahsmith-rh in #27
- Keep jobs running across queue restarts by @taagarwa-rh in #35
New Contributors
Full Changelog: v0.2.0...v0.2.1
v0.2.0
What's Changed
- ✨ Add support for managing models on nebius by @taagarwa-rh in #24
- Add container versioning by @taagarwa-rh in #25
- Bump version: 0.1.0 → 0.2.0 by @taagarwa-rh in #26
Full Changelog: 0.1.0...v0.2.0
v0.1.0
What's Changed
- Fix OpenShift environment for container compatibility by @MichaelClifford in #1
- 🐛 Improve openshift robustness by @taagarwa-rh in #2
- Add Qwen3.6-27B-FP8 deployment config and validation scripts by @hannahsmith-rh in #4
- ✨ Add OpenShift job queue service by @taagarwa-rh in #3
- ✨ Add OpenShift job queue service by @taagarwa-rh in #5
- Add generate-manifest and deploy CLI commands by @hannahsmith-rh in #6
- Feat/job improvements by @taagarwa-rh in #8
- fix(openclaw): pin version to 2026.6.1 to avoid TTY onboarding error by @rounakbende10 in #11
- feat: add resume endpoint for retrying errored tasks by @rounakbende10 in #12
- feat(resume): add server_url, model_name, before_script overrides by @rounakbende10 in #13
- 🐛 Fix uv cache permission error in container by @hannahsmith-rh in #14
- fix(resume): regenerate Pi/Codex mount files with new server URL by @rounakbende10 in #16
- Fix resume server_url to replace across all JSON files by @hannahsmith-rh in #15
- fix(resume): pre-delete errored trials to enable repeated resumes by @rounakbende10 in #17
- fix(resume): simplify endpoint, add HOME=/tmp, remove unnecessary overrides by @rounakbende10 in #18
- fix(resume): add Pi models.json regeneration on URL change by @rounakbende10 in #19
- Add agent version pinning, URL normalization, and metrics fixes by @rounakbende10 in #21
- Add --gpu-cost-per-hour CLI arg to calculate_metrics by @rounakbende10 in #20
- Fix Codex config generation for current @openai/codex by @cplegendre in #7
- 📌 Move harbor dep to point at redhat-et fork by @taagarwa-rh in #22
- Add imagestreamtags to harbor-orchestrator RBAC by @rounakbende10 in #23
New Contributors
- @MichaelClifford made their first contribution in #1
- @hannahsmith-rh made their first contribution in #4
- @rounakbende10 made their first contribution in #11
- @cplegendre made their first contribution in #7
Full Changelog: https://github.com/redhat-et/coding_agent_bench/commits/v0.1.0