First public release on PyPI. (Version 0.1.0 was tagged in git as part
of pre-release work but was never published to PyPI; 0.1.1 is the first
version users can pip install.)
Added
ab/asr-robustsuite: speech recognition underclean,noise-cafe-10db,
noise-pink-5db,bandlimited-8k, andreverb-mediumconditions. Reports
per-condition WER and a weighted mean. Default model: Whisper.ab/sound-idsuite: sound-event identification on labeled mixtures, with
solo/pair/triple/quadmixture-size conditions. Reports
recall, precision, F1, and false-positive rate per(pack, condition),
plus a headline "components understood: X / Y" number.- Bundled
demopack runs end-to-end on a fresh laptop with no GPU, no
weight downloads, and no network. Five additional packs (core,home,
cabin,security,health) reference user-supplied datasets at
~/.cache/audiobench/sound_id/. - Four model adapters for
ab/sound-id:heuristic-v0andheuristic-weak: deterministic spectral matchers
bundled with the package; no GPU, no downloads.clap-base: LAION-CLAP zero-shot. Lazy-imported.qwen2-audio-7b: Qwen2-Audio-Instruct via localtransformersor a
remote endpoint viaAUDIOBENCH_QWEN_ENDPOINT. Lazy-imported.
- Versioned prompt protocol pinned in
run_hash(prompt_version,
parser_version,prompt_ensemble, plus a SHA-256 over the canonicalized
paraphrase list).audiobench comparerefuses mismatched prompts unless
--allow-mismatched-promptis passed. - Recipe-driven mixture authoring: bundled defaults, inline
--mix "label1+label2", and YAML/JSON recipe files with per-source dB levels. - Mixture preview command:
audiobench mix previewwrites a WAV without
running probes. - Forensic per-mixture view:
audiobench inspect <run.json> --mixture N. audiobench comparefor both suites;audiobench pushwrites a signed
local payload (no network in MVP mode).- Reproducibility guarantees: fixed manifest/mixture/probe seeds,
deterministic mixer, and arun_hashSHA-256 over the canonicalized run
payload (mixture spec + prompt config) written into every run JSON. - Optional installs:
pip install "audiobench[clap]"— adds the LAION-CLAP zero-shot adapter.pip install "audiobench[qwen]"— adds local Qwen2-Audio via
transformers+torch.pip install "audiobench[docs]"— MkDocs Material toolchain.pip install "audiobench[dev]"—pytest,build,twine.