Easy ASR Bench v0.4.0

Easy ASR Bench v0.4.0

Release status: automated packaging checks may be present, but this is not an all-pass manual smoke release because required rows remain unverified.

What changed

• Added browser-local persistence plus JSON export/import for corrected-reference edits in final_results.html, so pasted corrections survive report reloads and can be moved to another browser. Open_Latest_Report.bat now prefers final_results.html reports before falling back to per-file compare.html, single-file runs now write a lightweight final_results.html wrapper, and README report guidance now presents final_results.html as the main report entry point.
• Added installed-app Start Menu shortcuts for running Easy ASR Bench, dropping audio/folders, opening the latest report, opening the output folder, editing config, repair, and uninstall; uninstall removes the shortcut folder while preserving user data by default.
• Consolidated missing runtime dependency prompts into one pre-processing decision for all selected model groups. Interactive runs can install all, skip affected models, print every repair command, or quit before inference starts; noninteractive runs now fail affected models early with a clear pre-processing message instead of prompting during a batch.
• Hardened release-smoke evidence integrity: runtime-matrix rows now record execution Git commit and clean/dirty state, merged smoke rows keep the target release commit separate from execution evidence, strict validation rejects stale execution commits unless an explicit exception is documented, and duplicate same-row evidence cannot hide a fail behind a later pass.
• Hardened the Hugging Face downloader: repo inspection resolves floating revisions to a Hub commit when available, choices carry total-byte metadata, large-download confirmation is based on byte size, common GGUF Q4-family packages get a blank-Enter default recommendation, a resumable hf_model_layout_repair_plan.json is written before the first file download, failures print the exact doctor repair command, closed stdin exits cleanly, gated/private errors include token guidance, and users are warned about Hub cache plus Models-folder disk usage.
• Implemented the configured update checks: setup runs the setup-scoped GitHub latest-release check after config initialization, app startup honors check_for_updates_on_run, and offline or malformed update responses report a non-fatal unavailable status.
• Added a top-level crash handler for unexpected app errors. Config-load, model-scan, report-write, and other unhandled failures now write Logs/crash_*.log and print a short support path with doctor diagnostics and the GitHub issue URL instead of leaving a raw traceback as the only user-facing output.
• Added a public bug-report issue template and support docs that request doctor JSON, latest logs, Windows/install details, and model/runtime type. Setup documentation now explains unsigned script warnings, SmartScreen/Defender/AV behavior, what setup downloads, checksum verification, local-only media/model handling, and safe quarantine troubleshooting.
• Pinned the v0.4.0 llama.cpp Python package path to the verified llama-cpp-python==0.3.28 version across CPU, CUDA, Vulkan prebuilt-wheel, and explicit Vulkan source-build flows so clean-machine repair does not silently drift to a different wheel.
• Added disk-space preflights before Hugging Face model downloads and large runtime dependency installs. Hugging Face downloads estimate cache plus Models-folder space when size metadata is available and require typed override on low space; dependency installs record the space check and block low-space installs unless dependency_install.allow_low_disk_space_install is explicitly enabled.
• Added doctor path diagnostics for risky Windows locations: non-ASCII install/user-profile paths and OneDrive or redirected paths now appear in doctor JSON/text output, with a runtime-matrix row covering the warning contract.
• Added repeat-last-run model selection persistence. Interactive model choices save compact candidate IDs and precision buckets in config.json; blank Enter reuses a still-valid saved selection, and drag/drop runs use the saved selection unattended while stopping with a clear stale-selection message if saved IDs no longer exist.
• Added batch resume checkpointing in Logs/batch_resume_manifest.json. Completed file/model pairs are recorded with input fast keys and a config/model signature, reruns skip files whose selected pairs are already complete, stale input/config changes invalidate the checkpoint, and interrupted batches write a partial final_results.html summary when completed rows exist.
• Clarified the first-run baseline: Systran/faster-whisper-tiny.en is presented as a small CPU-first, English-only, one-model sanity baseline rather than a ranking comparison pack, and first-run smoke JSON records those limits plus the size-gated downloader path.
• Added stale temp WAV cleanup on startup and doctor runs. Generated *_16k_mono.wav files older than advanced.stale_temp_wav_hours are removed from Temp, recent active files are preserved, and advanced.keep_temp_wavs=true disables the sweep.
• Closed the still-valid v0.3.9 release-audit gaps around release QA gates: the staged bad-checksum runtime row now runs on CI without a GitHub Actions skip, Windows release QA wrappers require an explicit vX.Y.Z tag instead of stale defaults, and the shipped default config now starts CPU-first with accelerator package installs disabled until explicitly opted in.
• Aligned llama.cpp Vulkan runtime planning with the installer path: machines with a Vulkan runtime now select the Vulkan prebuilt-wheel route even without the Vulkan SDK, GPU layers remain disabled until backend offload is verified, and explicit source builds use a separate requirements/llama_cpp_vulkan_source_build.txt file with SDK/build tooling opt-in.
• Fixed the direct --download-model CLI path so a successful Hugging Face model download immediately rescans and continues into the normal interactive or scan-only flow instead of telling the user to restart, and corrected the README batch-output tree to the actual final_results.html plus _data JSON layout.
• Added a generated support matrix at docs/support_matrix.generated.md that is rebuilt from release-smoke-v0.4.0.json, reports required-row pass counts, and keeps unproven CUDA/Vulkan/AMD/provider rows marked Not verified until release-smoke evidence marks them pass.
• Refreshed the local v0.4.0 Windows ZIP after post-audit hardening; the current package SHA256 is c10f0213f206545556ec5d6efede10f1c43b29c6ab4bd81f2cc2b184c9ab821b. Full pytest passed after the changes (609 passed), along with pip check, release-file validation, repo/ZIP physical-file validation, strict checksum rebuild, setup dry-run, setup JSON dry-run, tracked public hygiene, smoke public hygiene, and strict required-row smoke validation.
• Hardened the Windows Sandbox clean-bootstrap script with per-step JSON/stdout/stderr/exit-code sentinels, short dry-run preflight evidence, command-shape preservation across PowerShell jobs, and a real setup.bat --local --no-post-setup-menu bootstrap step before doctor repair. The first real clean Sandbox phase now fails fast on missing Python bootstrap support instead of hanging or falsely passing.
• Added a clean-Windows Python bootstrap fallback for environments such as Windows Sandbox where winget is unavailable: setup.bat --local now downloads and silently installs the official Python 3.12.10 x64 installer from python.org, then verifies py -3.12, python, or the per-user install path before creating the project venv.
• Bounded the clean-Windows Python fallback download by trying curl.exe with connect/overall timeouts before the PowerShell fallback, checking that the installer file is actually present and larger than 1 MB before executing it, and disabling PowerShell progress output so Sandbox bootstrap does not appear frozen during installer download.
• Added a release-hardening regression check that setup.bat is UTF-8 without a BOM after Sandbox caught cmd.exe interpreting the BOM as part of @echo off.
• Updated the Windows Sandbox startup script to run post-bootstrap runtime rows, full real-smoke, and release-smoke scripts through the newly created .venv\Scripts\python.exe instead of relying on the Sandbox process PATH to discover python.
• Hardened clean-VM dependency repair after Sandbox proof reached strict ASR/LLM rows: llama-cpp-python now falls back to the official prebuilt CPU wheel index instead of a local source build when accelerator wheels are not usable, OpenVINO provider repair skips unavailable compatibility versions before trying the next candidate, and clean-bootstrap first-run smoke parsing accepts final JSON payloads after diagnostic log lines.
• Tightened clean-bootstrap runtime-row parsing and provider fallback after the next Sandbox pass: setup repair-all-safe rows now parse schema-bearing JSON payloads from noisy doctor output, and auto-detected OpenVINO provider failures no longer block CPU fallback while explicit OpenVINO requests remain strict.
• Fixed the remaining clean-Sandbox llama-cpp fallback path so an unavailable accelerator wheel index installs from the prebuilt CPU wheel index instead of returning to the source-build requirements file on machines without native build tools.
• Fixed setup repair-all-safe runtime-row parsing to select the top-level repair-plan JSON payload, not nested runtime-resolution schema objects embedded later in the same doctor output.
• Added a clean-Windows Visual C++ Redistributable bootstrap step to setup.bat: setup now verifies the x64 runtime before doctor/self-test, prefers the winget package when available, and falls back to Microsoft’s supported x64 redistributable permalink with bounded download checks when winget is absent.
• Hardened clean-machine native...

Easy ASR Bench v0.3.9

Easy ASR Bench v0.3.9

Release status: preview / prerelease. This is a much larger validation and product-path release than v0.3.8, with real model/runtime smoke coverage, expanded bootstrap repair behavior, a redesigned batch report, and explicit blocked evidence for the rows this machine cannot prove. It is not promoted as an all-pass stable release because clean Windows Sandbox/VM, NVIDIA CUDA, and Intel provider rows still require external hardware/OS evidence.

What changed

• Added real end-to-end ASR/LLM validation paths around the normal product flow instead of only mocked unit coverage. The v0.3.9 smoke artifact now carries 110 pass / 12 blocked / 0 not_run manual rows, with blocked rows recorded as explicit external requirements.
• Added full real-smoke doctor support for the major runnable paths: faster-whisper/CTranslate2, OpenAI Whisper .pt, whisper.cpp GGML, Hugging Face Safetensors ASR, Generic ONNX CTC, ASR GGUF+mmproj, SmolLM GGUF reference/correction, and same-media multi-model benchmark rows.
• Added real public folder-batch validation with multiple speech files, multiple ASR backends per file, SmolLM 135M GGUF correction/scoring, and generated final batch reports that show corrected references, transcripts, ranking, timing, RAM, and VRAM/GPU memory.
• Redesigned the batch report into the main user-facing result view: final_results.html opens to an overall model ranking, simple file picker, per-file winners, full model transcripts, corrected-reference editor, direct two-model comparison, and advanced raw paths hidden behind details.
• Added live corrected-reference editing in the report. Pasted ChatGPT/Claude text rescoring/highlights immediately, shows a visible update confirmation, and can be reset per file.
• Improved transcript diff readability: true word changes are red, punctuation/case differences are yellow and separate from the winner score, missing reference words are distinct, and very high WER values get a compact non-clipping warning.
• Hardened setup/bootstrap repair behavior for missing, stale, corrupt, incompatible, and provider-specific dependency states, including Python packaging tools, Visual C++ runtime, faster-whisper/CTranslate2 native load failures, ONNX provider conflicts, Transformers/Torch dependency groups, and llama.cpp/MTMD native runtime discovery.
• Fixed the v0.3.8 audit blocker in standalone one-file setup: setup.bat now downloads install.ps1 through a precomputed temp path instead of using stale %INSTALLER_PS1% expansion inside a batch block.
• Added lonely one-file setup coverage to public asset smoke and GitHub Actions, so release verification runs from a folder containing only setup.bat, matching the normal-user download path.
• Fixed Run.bat --doctor --strict parity by passing --strict through app.main into app.doctor.
• Expanded Hugging Face downloader/package handling for sequential link entry, invalid-link retry, sharded Safetensors indexes, ONNX sidecars, split GGUF parts, GGUF ASR mmproj pairing, and quant/precision classification.
• Added Windows Sandbox clean-bootstrap deployment scaffolding. On supported Windows Pro/Enterprise/Education hosts it generates a .wsb plus startup script that runs setup repair, model-layout repair, clean VM bootstrap proof, full real-smoke doctor, release-smoke generation, evidence merge, and validation.
• Updated GitHub Actions to front-load setup/workflow contract tests before the full pytest run, reducing expensive failures from YAML/script syntax or bootstrap regression.

Automated Packaging Checks

• Built from commit: dc5c895a349f924693c1a50eec8b057a7abab3ed.
• Local release file validation passed.
• Local physical source validation passed.
• Local ZIP build/layout validation passed for Easy-ASR-Bench-v0.3.9-win.zip.
• Staged setup verification passed with setup.bat --dry-run --verify-release --asset-dir dist\release-assets.
• Release smoke validation passed with required rows, log hashes, and environment summaries.

Manual Smoke Rows Marked Pass

• 110 manual release rows are marked pass in release-smoke-v0.3.9.json.
• Coverage includes setup/doctor repair contracts, dependency repair isolation, model-layout repair, media handling, OpenAI Whisper .pt safety, whisper.cpp, faster-whisper/CTranslate2 repair, HF Safetensors, Generic ONNX CTC, ASR GGUF+mmproj, SmolLM correction/scoring, same-media CPU/DirectML benchmark rows, report/reference validation, and batch report UX proof.

Still Blocked / Pending External Evidence

• win11_clean_no_python_setup: requires a clean Windows 11 VM/Sandbox where Python is not visible before setup.
• windows_sandbox_clean_bootstrap_deploy: this laptop is Windows Home/Core and does not expose Windows Sandbox.
• clean_vm_zero_dependency_bootstrap: requires explicit clean VM/Sandbox proof with EASY_ASR_BENCH_CLEAN_VM_BOOTSTRAP_PROOF=1.
• win10_existing_python_setup: requires a Windows 10 VM state.
• NVIDIA CUDA rows remain blocked on this machine: hardware detection, Torch CUDA tensor smoke, ONNX Runtime CUDA, faster-whisper/CTranslate2 CUDA, llama.cpp CUDA/SmolLM, and the combined CUDA row.
• Intel provider rows remain blocked on this machine: Intel DirectML hardware and OpenVINO provider smoke.

Release assets

• Easy-ASR-Bench-v0.3.9-win.zip: sha256:4f76a8c8c56eed16e27ed27bf8309f42b8c12acb6d490bf68dff4a8c9b2dca97
• setup.bat: sha256:ff28e044d4212f54186e705b06020c34df43cc6bd2f70047489d2ca3ed55886a
• install.ps1: sha256:21701f93b0b662962a5dae3df3f4f134de4e0b3fc52d2b2c82cda0ae4b496aa4
• manifest.json: sha256:02a9ab2a9b58df9651b52cd1c8005b3d0bae6bfe3a0e246331b891e7be607e1d

Known limits

• This is still a preview/prerelease until the external clean Windows Sandbox/VM and NVIDIA CUDA evidence is merged and strict all-pass validation succeeds.
• CUDA package installation remains conservative; CPU fallback is explicit when CUDA is requested but not verified.
• VRAM/GPU memory telemetry is reported separately from RAM and depends on Windows GPU counters or backend-specific metrics.
• Unsafe pickle-backed .pt checkpoints remain blocked unless explicitly trusted through the supported safety path.

Easy ASR Bench v0.3.8

Easy ASR Bench v0.3.8

Release status: automated packaging checks may be present, but this is not an all-pass manual smoke release because required rows remain unverified.

What changed

• Added Run.bat --doctor --json / python -m app.main --doctor --json so Windows public-asset QA can capture release identity, dependency status, provider diagnostics, and folder paths as machine-readable evidence.
• Changed setup.bat --doctor to forward extra doctor flags such as --json and --strict, keeping setup as a single QA/user entrypoint.
• Added Run.bat --first-run-smoke / python -m app.main --first-run-smoke so QA can prove the first-run state has actionable next steps without network use or interactive input.
• Added qa/windows_matrix/run_public_asset_smoke.ps1 to download public release assets, verify staged setup, record asset hashes, and optionally install/capture installed-app doctor.json plus first-run-smoke.json.
• Added scripts/merge_release_evidence.py so collected row.json evidence can update the release-smoke-vX.Y.Z.json artifact consumed by release notes and strict validation.
• Documented the new public-asset runner and installed-app JSON capture commands in release verification guidance.

Automated Packaging Checks

• Built from commit: d4d0bab.
• Public setup verification path: setup.bat --dry-run --verify-release.
• GitHub Actions Release Gate must pass before a release should be promoted.
• release_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_release_files.py
• repo_physical_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_physical_files.py --repo .
• zip_physical_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_physical_files.py --zip D:\a\Easy-ASR-Bench\Easy-ASR-Bench\dist\Easy-ASR-Bench-v0.3.8-win.zip
• version_coherence: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/check_release_version_coherence.py --tag v0.3.8

Manual Smoke Rows Marked Pass

• No manual Windows/model/provider/media rows are marked pass in the smoke artifact.

Not Verified In Release Smoke

• win11_clean_no_python_setup: not_run
• win10_existing_python_setup: not_run
• install_path_with_spaces: not_run
• setup_verify_release_bad_checksum: not_run
• setup_double_click_equivalent: not_run
• setup_dry_run_verify_release: not_run
• setup_doctor_strict: not_run
• update_preserves_user_data: not_run
• repair_broken_venv: not_run
• uninstall_preserve_user_data: not_run
• destructive_uninstall_requires_phrase: not_run
• bad_checksum_fails_before_execution: not_run
• tampered_installer_fails_before_execution: not_run
• interrupted_download_rollback: not_run
• broken_venv_repair: not_run
• empty_models_folder: not_run
• empty_models: not_run
• nested_models_folders: not_run
• nested_models_scan: not_run
• wav_mp3_mp4_no_audio_corrupt_media: not_run
• wav_mp3_mp4_media: not_run
• corrupt_media_readable_error: not_run
• no_audio_video_readable_error: not_run
• compare_html_offline_large_transcript: not_run
• compare_html_offline: not_run
• batch_continues_after_one_model_or_chunk_fails: not_run
• one_model_failure_continues: not_run
• one_chunk_failure_continues: not_run
• llm_reference_json_import: not_run
• dependency_install_declined: not_run
• cpu_model_smoke: not_run
• nvidia_cuda_torch_onnx_faster_whisper_llama: not_run
• amd_directml_onnx_smoke: not_run
• intel_directml_onnx_smoke: not_run
• intel_openvino_onnx_smoke: not_run
• vulkan_runtime_no_sdk: not_run
• vulkan_runtime_with_sdk: not_run
• hf_safetensors_asr: not_run
• hf_whisper_safetensors: not_run
• hf_whisper_safetensors_cpu: not_run
• sharded_safetensors_index: not_run
• faster_whisper_ctranslate2: not_run
• faster_whisper_cpu: not_run
• faster_whisper_cuda_unavailable_cpu_fallback: not_run
• whisper_cpp_ggml: not_run
• openai_whisper_pt_checksum_verified: not_run
• openai_whisper_pt_unknown_blocked: not_run
• openai_pt_unverified_blocked: not_run
• generic_onnx_ctc_manifest_v1: not_run
• generic_onnx_manifest_cpu: not_run
• generic_onnx_without_manifest_rejected: not_run
• multi_file_onnx_ar_nar: not_run
• audio_asr_gguf_mmproj: not_run
• gguf_asr_mmproj_pair: not_run
• incomplete_audio_asr_gguf_mmproj_rejected: not_run
• gguf_reference_llm: not_run
• gguf_text_llm_reference_only: not_run
• standalone_safetensors_incomplete: not_run
• hf_text_llm_safetensors_unsupported: not_run
• known_unsupported_asr_families_explained: not_run

Release assets

• Easy-ASR-Bench-v0.3.8-win.zip: sha256:b316d9f4958176c48906b4226378f91ad9206446395212a64a482174a67d8045
• install.ps1: sha256:5b60faa21fce97ea806c1af28dd627578164393d83301a542cbc529eb86bbe4d
• manifest.json: sha256:0798dc8c03d87f968a603d4be3a86764d77fbbd3d800f7e6c97ebdf816c30fed
• setup.bat: sha256:b6a46510ffa52beb540ba18b2cd44bd7aac4753794d8748b35931d9ba20a8b1a

Known limits

• Optional model dependency groups install only when needed.
• GPU/VRAM metrics require a CUDA-capable runtime; CPU runs report VRAM as null.
• Unsafe pickle-backed .pt checkpoints remain blocked unless explicitly trusted.

Easy ASR Bench v0.3.7

Easy ASR Bench v0.3.7

Release status: automated packaging checks may be present, but this is not an all-pass manual smoke release because required rows remain unverified.

What changed

• Changed prerelease builds to report prerelease from runtime environment and doctor output instead of trusting stale config.json channel values.
• Added failed-file report generation for pre-model failures so bad media, preprocessing errors, or similar file-level failures still write results.json, results.txt, benchmark.csv, and compare.html with cause and next-action text.
• Changed batch/queue status detection so structured failed-file reports are marked failed in queue state and batch dashboards instead of being mislabeled as completed just because an output folder exists.
• Added more specific failed-file stages for no-audio/media-probe, FFmpeg/decode, and path/permission failures.
• Expanded setup completion into direct first-run choices for running the app, pasting a Hugging Face model link, opening Models, opening Input, or quitting.
• Added a dedicated first-run wizard with a recommended CPU baseline download path, Hugging Face paste flow, folder-open actions, and automatic continuation into the app after a successful model download.
• Added faster-whisper/CTranslate2 package detection to the Hugging Face downloader so baseline ASR repos with model.bin, config.json, and tokenizer/vocabulary files can be downloaded as one runnable package.
• Added app commands for model download and folder-opening actions so setup can route users through product actions without exposing Python commands.
• Reworked optional dependency recovery prompts into explicit install, skip affected models, show repair command, and quit-batch choices.
• Changed queue discovery and direct batch processing to enqueue by fast file identity before full SHA256 hashing, avoiding long startup stalls on large media while preserving result-level source hashes.
• Added focused regression coverage for release-channel truth, stale-config doctor output, first-run guidance, setup choices, dependency prompt choices, and failed-file reports.

Automated Packaging Checks

• Built from commit: c5ae6da.
• Public setup verification path: setup.bat --dry-run --verify-release.
• GitHub Actions Release Gate must pass before a release should be promoted.
• release_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_release_files.py
• repo_physical_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_physical_files.py --repo .
• zip_physical_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_physical_files.py --zip D:\a\Easy-ASR-Bench\Easy-ASR-Bench\dist\Easy-ASR-Bench-v0.3.7-win.zip
• version_coherence: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/check_release_version_coherence.py --tag v0.3.7

Manual Smoke Rows Marked Pass

• No manual Windows/model/provider/media rows are marked pass in the smoke artifact.

Not Verified In Release Smoke

• win11_clean_no_python_setup: not_run
• win10_existing_python_setup: not_run
• install_path_with_spaces: not_run
• setup_verify_release_bad_checksum: not_run
• setup_double_click_equivalent: not_run
• setup_dry_run_verify_release: not_run
• setup_doctor_strict: not_run
• update_preserves_user_data: not_run
• repair_broken_venv: not_run
• uninstall_preserve_user_data: not_run
• destructive_uninstall_requires_phrase: not_run
• bad_checksum_fails_before_execution: not_run
• tampered_installer_fails_before_execution: not_run
• interrupted_download_rollback: not_run
• broken_venv_repair: not_run
• empty_models_folder: not_run
• empty_models: not_run
• nested_models_folders: not_run
• nested_models_scan: not_run
• wav_mp3_mp4_no_audio_corrupt_media: not_run
• wav_mp3_mp4_media: not_run
• corrupt_media_readable_error: not_run
• no_audio_video_readable_error: not_run
• compare_html_offline_large_transcript: not_run
• compare_html_offline: not_run
• batch_continues_after_one_model_or_chunk_fails: not_run
• one_model_failure_continues: not_run
• one_chunk_failure_continues: not_run
• llm_reference_json_import: not_run
• dependency_install_declined: not_run
• cpu_model_smoke: not_run
• nvidia_cuda_torch_onnx_faster_whisper_llama: not_run
• amd_directml_onnx_smoke: not_run
• intel_directml_onnx_smoke: not_run
• intel_openvino_onnx_smoke: not_run
• vulkan_runtime_no_sdk: not_run
• vulkan_runtime_with_sdk: not_run
• hf_safetensors_asr: not_run
• hf_whisper_safetensors: not_run
• hf_whisper_safetensors_cpu: not_run
• sharded_safetensors_index: not_run
• faster_whisper_ctranslate2: not_run
• faster_whisper_cpu: not_run
• faster_whisper_cuda_unavailable_cpu_fallback: not_run
• whisper_cpp_ggml: not_run
• openai_whisper_pt_checksum_verified: not_run
• openai_whisper_pt_unknown_blocked: not_run
• openai_pt_unverified_blocked: not_run
• generic_onnx_ctc_manifest_v1: not_run
• generic_onnx_manifest_cpu: not_run
• generic_onnx_without_manifest_rejected: not_run
• multi_file_onnx_ar_nar: not_run
• audio_asr_gguf_mmproj: not_run
• gguf_asr_mmproj_pair: not_run
• incomplete_audio_asr_gguf_mmproj_rejected: not_run
• gguf_reference_llm: not_run
• gguf_text_llm_reference_only: not_run
• standalone_safetensors_incomplete: not_run
• hf_text_llm_safetensors_unsupported: not_run
• known_unsupported_asr_families_explained: not_run

Release assets

• Easy-ASR-Bench-v0.3.7-win.zip: sha256:2e4131d3fea68ee4adde9df4b9d011b4fa2ecf1b98016b6371fb403f6f6498fe
• install.ps1: sha256:0481daaca56d0fdb7a43178bb2a45cd0e8947259e3c118d01026cf8b9ea1be8c
• manifest.json: sha256:767ef5f8f4c0f4bfb0478413dbbb2303631d6eba3cb1bc02b88c986986f2528a
• setup.bat: sha256:2460339996133491c8623c78006ac96351d08165fd1933ebcbe1214dff44cd4b

Known limits

• Optional model dependency groups install only when needed.
• GPU/VRAM metrics require a CUDA-capable runtime; CPU runs report VRAM as null.
• Unsafe pickle-backed .pt checkpoints remain blocked unless explicitly trusted.

Easy ASR Bench v0.3.6

Easy ASR Bench v0.3.6

Release status: automated packaging checks may be present, but this is not an all-pass manual smoke release because required rows remain unverified.

What changed

• Changed release-note generation so it no longer writes unconditional "passed" claims from static prose; automated checks now come from the smoke artifact, and releases with any non-pass manual rows are labeled as not all-pass manual smoke releases.
• Changed changelog extraction for release notes so "still not claimable" caveat bullets are not accidentally promoted into the "What changed" section.
• Clarified raw GitHub byte diagnostics so canonical Git blob LF line endings are not mistaken for collapsed files when physical_line_count_universal is correct.
• Expanded the Windows release matrix helper to include all current manual smoke rows, not just a subset.
• Hardened Windows evidence collection so rows marked pass must include app version, release commit, environment summary, and log/result artifact hashes.
• Tightened GitHub release verification so v2 smoke artifacts must include explicit manual_rows, even when those rows are not_run.
• Documented that README model support describes complete code-supported packages, while per-release verification is controlled by the smoke artifact.

Automated Packaging Checks

• Built from commit: 6caeeef.
• Public setup verification path: setup.bat --dry-run --verify-release.
• GitHub Actions Release Gate must pass before a release should be promoted.
• release_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_release_files.py
• repo_physical_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_physical_files.py --repo .
• zip_physical_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_physical_files.py --zip D:\a\Easy-ASR-Bench\Easy-ASR-Bench\dist\Easy-ASR-Bench-v0.3.6-win.zip
• version_coherence: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/check_release_version_coherence.py --tag v0.3.6

Manual Smoke Rows Marked Pass

• No manual Windows/model/provider/media rows are marked pass in the smoke artifact.

Not Verified In Release Smoke

• win11_clean_no_python_setup: not_run
• win10_existing_python_setup: not_run
• install_path_with_spaces: not_run
• setup_verify_release_bad_checksum: not_run
• setup_double_click_equivalent: not_run
• setup_dry_run_verify_release: not_run
• setup_doctor_strict: not_run
• update_preserves_user_data: not_run
• repair_broken_venv: not_run
• uninstall_preserve_user_data: not_run
• destructive_uninstall_requires_phrase: not_run
• bad_checksum_fails_before_execution: not_run
• tampered_installer_fails_before_execution: not_run
• interrupted_download_rollback: not_run
• broken_venv_repair: not_run
• empty_models_folder: not_run
• empty_models: not_run
• nested_models_folders: not_run
• nested_models_scan: not_run
• wav_mp3_mp4_no_audio_corrupt_media: not_run
• wav_mp3_mp4_media: not_run
• corrupt_media_readable_error: not_run
• no_audio_video_readable_error: not_run
• compare_html_offline_large_transcript: not_run
• compare_html_offline: not_run
• batch_continues_after_one_model_or_chunk_fails: not_run
• one_model_failure_continues: not_run
• one_chunk_failure_continues: not_run
• llm_reference_json_import: not_run
• dependency_install_declined: not_run
• cpu_model_smoke: not_run
• nvidia_cuda_torch_onnx_faster_whisper_llama: not_run
• amd_directml_onnx_smoke: not_run
• intel_directml_onnx_smoke: not_run
• intel_openvino_onnx_smoke: not_run
• vulkan_runtime_no_sdk: not_run
• vulkan_runtime_with_sdk: not_run
• hf_safetensors_asr: not_run
• hf_whisper_safetensors: not_run
• hf_whisper_safetensors_cpu: not_run
• sharded_safetensors_index: not_run
• faster_whisper_ctranslate2: not_run
• faster_whisper_cpu: not_run
• faster_whisper_cuda_unavailable_cpu_fallback: not_run
• whisper_cpp_ggml: not_run
• openai_whisper_pt_checksum_verified: not_run
• openai_whisper_pt_unknown_blocked: not_run
• openai_pt_unverified_blocked: not_run
• generic_onnx_ctc_manifest_v1: not_run
• generic_onnx_manifest_cpu: not_run
• generic_onnx_without_manifest_rejected: not_run
• multi_file_onnx_ar_nar: not_run
• audio_asr_gguf_mmproj: not_run
• gguf_asr_mmproj_pair: not_run
• incomplete_audio_asr_gguf_mmproj_rejected: not_run
• gguf_reference_llm: not_run
• gguf_text_llm_reference_only: not_run
• standalone_safetensors_incomplete: not_run
• hf_text_llm_safetensors_unsupported: not_run
• known_unsupported_asr_families_explained: not_run

Release assets

• Easy-ASR-Bench-v0.3.6-win.zip: sha256:1279d54a434f7485bf94898541a65df44fec835beb1cd1d1f28cb31283fcb792
• install.ps1: sha256:325ca6be73bf14dbfd90d5381df7e7da3ddd0c772713783512e267bde05b6040
• manifest.json: sha256:60ae01a842b884c1f426c709ea7eb43310f1122702b388b4ad10e56341d1ee64
• setup.bat: sha256:80dc6b25444e0bb7a5fbf3332301a3cfdbcd4577b1d19857ad94ce7ecf235f66

Known limits

• Optional model dependency groups install only when needed.
• GPU/VRAM metrics require a CUDA-capable runtime; CPU runs report VRAM as null.
• Unsafe pickle-backed .pt checkpoints remain blocked unless explicitly trusted.

Easy ASR Bench v0.3.5

Easy ASR Bench v0.3.5

Superseded

This release is superseded by v0.3.6 and should not be treated as the current audit target.

Use v0.3.6 or newer for public review:

https://github.com/rollingedit/Easy-ASR-Bench/releases/tag/v0.3.6

Why This Was Changed

v0.3.6 corrected the release-proof wording and verification flow so public release notes no longer imply an all-pass manual Windows/model/provider/media smoke matrix when those rows are still unverified.

The v0.3.5 assets remain attached for historical traceability, but this release is now marked as a prerelease to avoid presenting it as the current stable/public review build.

Easy ASR Bench v0.3.3

Easy ASR Bench Historical Build

Superseded

This historical release is superseded by v0.3.6 and should not be used as the current audit target.

Use v0.3.6 or newer for public review:

https://github.com/rollingedit/Easy-ASR-Bench/releases/tag/v0.3.6

Current Release Status

v0.3.6 is the public audit build with corrected release-proof wording, public setup verification, release asset verification, and explicit manual-smoke scope.

This older release remains attached for historical traceability only.

Easy ASR Bench v0.3.2

Easy ASR Bench Historical Build

Superseded

This historical release is superseded by v0.3.6 and should not be used as the current audit target.

Use v0.3.6 or newer for public review:

https://github.com/rollingedit/Easy-ASR-Bench/releases/tag/v0.3.6

Current Release Status

v0.3.6 is the public audit build with corrected release-proof wording, public setup verification, release asset verification, and explicit manual-smoke scope.

This older release remains attached for historical traceability only.

Easy ASR Bench v0.3.0

Easy ASR Bench Historical Build

Superseded

This historical release is superseded by v0.3.6 and should not be used as the current audit target.

Use v0.3.6 or newer for public review:

https://github.com/rollingedit/Easy-ASR-Bench/releases/tag/v0.3.6

Current Release Status

v0.3.6 is the public audit build with corrected release-proof wording, public setup verification, release asset verification, and explicit manual-smoke scope.

This older release remains attached for historical traceability only.

Easy ASR Bench v0.2.9

Easy ASR Bench Historical Build

Superseded

This historical release is superseded by v0.3.6 and should not be used as the current audit target.

Use v0.3.6 or newer for public review:

https://github.com/rollingedit/Easy-ASR-Bench/releases/tag/v0.3.6

Current Release Status

v0.3.6 is the public audit build with corrected release-proof wording, public setup verification, release asset verification, and explicit manual-smoke scope.

This older release remains attached for historical traceability only.