Skip to content

Easy ASR Bench v0.3.7

Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 07 Jun 13:57
· 225 commits to main since this release

Easy ASR Bench v0.3.7

Release status: automated packaging checks may be present, but this is not an all-pass manual smoke release because required rows remain unverified.

What changed

  • Changed prerelease builds to report prerelease from runtime environment and doctor output instead of trusting stale config.json channel values.
  • Added failed-file report generation for pre-model failures so bad media, preprocessing errors, or similar file-level failures still write results.json, results.txt, benchmark.csv, and compare.html with cause and next-action text.
  • Changed batch/queue status detection so structured failed-file reports are marked failed in queue state and batch dashboards instead of being mislabeled as completed just because an output folder exists.
  • Added more specific failed-file stages for no-audio/media-probe, FFmpeg/decode, and path/permission failures.
  • Expanded setup completion into direct first-run choices for running the app, pasting a Hugging Face model link, opening Models, opening Input, or quitting.
  • Added a dedicated first-run wizard with a recommended CPU baseline download path, Hugging Face paste flow, folder-open actions, and automatic continuation into the app after a successful model download.
  • Added faster-whisper/CTranslate2 package detection to the Hugging Face downloader so baseline ASR repos with model.bin, config.json, and tokenizer/vocabulary files can be downloaded as one runnable package.
  • Added app commands for model download and folder-opening actions so setup can route users through product actions without exposing Python commands.
  • Reworked optional dependency recovery prompts into explicit install, skip affected models, show repair command, and quit-batch choices.
  • Changed queue discovery and direct batch processing to enqueue by fast file identity before full SHA256 hashing, avoiding long startup stalls on large media while preserving result-level source hashes.
  • Added focused regression coverage for release-channel truth, stale-config doctor output, first-run guidance, setup choices, dependency prompt choices, and failed-file reports.

Automated Packaging Checks

  • Built from commit: c5ae6da.
  • Public setup verification path: setup.bat --dry-run --verify-release.
  • GitHub Actions Release Gate must pass before a release should be promoted.
  • release_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_release_files.py
  • repo_physical_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_physical_files.py --repo .
  • zip_physical_file_validation: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/validate_physical_files.py --zip D:\a\Easy-ASR-Bench\Easy-ASR-Bench\dist\Easy-ASR-Bench-v0.3.7-win.zip
  • version_coherence: pass - C:\hostedtoolcache\windows\Python\3.12.10\x64\python.exe scripts/check_release_version_coherence.py --tag v0.3.7

Manual Smoke Rows Marked Pass

  • No manual Windows/model/provider/media rows are marked pass in the smoke artifact.

Not Verified In Release Smoke

  • win11_clean_no_python_setup: not_run
  • win10_existing_python_setup: not_run
  • install_path_with_spaces: not_run
  • setup_verify_release_bad_checksum: not_run
  • setup_double_click_equivalent: not_run
  • setup_dry_run_verify_release: not_run
  • setup_doctor_strict: not_run
  • update_preserves_user_data: not_run
  • repair_broken_venv: not_run
  • uninstall_preserve_user_data: not_run
  • destructive_uninstall_requires_phrase: not_run
  • bad_checksum_fails_before_execution: not_run
  • tampered_installer_fails_before_execution: not_run
  • interrupted_download_rollback: not_run
  • broken_venv_repair: not_run
  • empty_models_folder: not_run
  • empty_models: not_run
  • nested_models_folders: not_run
  • nested_models_scan: not_run
  • wav_mp3_mp4_no_audio_corrupt_media: not_run
  • wav_mp3_mp4_media: not_run
  • corrupt_media_readable_error: not_run
  • no_audio_video_readable_error: not_run
  • compare_html_offline_large_transcript: not_run
  • compare_html_offline: not_run
  • batch_continues_after_one_model_or_chunk_fails: not_run
  • one_model_failure_continues: not_run
  • one_chunk_failure_continues: not_run
  • llm_reference_json_import: not_run
  • dependency_install_declined: not_run
  • cpu_model_smoke: not_run
  • nvidia_cuda_torch_onnx_faster_whisper_llama: not_run
  • amd_directml_onnx_smoke: not_run
  • intel_directml_onnx_smoke: not_run
  • intel_openvino_onnx_smoke: not_run
  • vulkan_runtime_no_sdk: not_run
  • vulkan_runtime_with_sdk: not_run
  • hf_safetensors_asr: not_run
  • hf_whisper_safetensors: not_run
  • hf_whisper_safetensors_cpu: not_run
  • sharded_safetensors_index: not_run
  • faster_whisper_ctranslate2: not_run
  • faster_whisper_cpu: not_run
  • faster_whisper_cuda_unavailable_cpu_fallback: not_run
  • whisper_cpp_ggml: not_run
  • openai_whisper_pt_checksum_verified: not_run
  • openai_whisper_pt_unknown_blocked: not_run
  • openai_pt_unverified_blocked: not_run
  • generic_onnx_ctc_manifest_v1: not_run
  • generic_onnx_manifest_cpu: not_run
  • generic_onnx_without_manifest_rejected: not_run
  • multi_file_onnx_ar_nar: not_run
  • audio_asr_gguf_mmproj: not_run
  • gguf_asr_mmproj_pair: not_run
  • incomplete_audio_asr_gguf_mmproj_rejected: not_run
  • gguf_reference_llm: not_run
  • gguf_text_llm_reference_only: not_run
  • standalone_safetensors_incomplete: not_run
  • hf_text_llm_safetensors_unsupported: not_run
  • known_unsupported_asr_families_explained: not_run

Release assets

  • Easy-ASR-Bench-v0.3.7-win.zip: sha256:2e4131d3fea68ee4adde9df4b9d011b4fa2ecf1b98016b6371fb403f6f6498fe
  • install.ps1: sha256:0481daaca56d0fdb7a43178bb2a45cd0e8947259e3c118d01026cf8b9ea1be8c
  • manifest.json: sha256:767ef5f8f4c0f4bfb0478413dbbb2303631d6eba3cb1bc02b88c986986f2528a
  • setup.bat: sha256:2460339996133491c8623c78006ac96351d08165fd1933ebcbe1214dff44cd4b

Known limits

  • Optional model dependency groups install only when needed.
  • GPU/VRAM metrics require a CUDA-capable runtime; CPU runs report VRAM as null.
  • Unsafe pickle-backed .pt checkpoints remain blocked unless explicitly trusted.