Skip to content

earshot 0.4.0: the sound of a launch film

Latest

Choose a tag to compare

@Leonxlnx Leonxlnx released this 22 Oct 20:55

earshot gives coding agents ears: it turns a sound file into evidence an agent can reason about, locally on CPU, as a
CLI, a Python API and an MCP server, and it lets an agent make its sound effects in code and check them by listening.

0.4 is about the sound of a music-led launch film: soft, short, mid-register effects mixed against the music instead
of over it. No new dependencies. The calm, crisp and minimal kits sound exactly as in 0.3.0 (all 191 of their takes
are byte-identical).

New

51 new sounds (the bank now holds 252)

Seven new families, all made from recipes in code: cut_hit (sub, kick, punch, rumble, air), reverse_swell,
ui_pop, knock, mallet (glockenspiel, celesta, marimba, chime runs), drip and shutter, plus new whooshes,
risers, swishes, glitches and mid dings. Every member is audited take by take (50 of 51 clean on 6 of 6 seeds, the
last on 5 of 6) and carries a measured originality: its largest CLAP cosine to any reference clip is 0.53-0.84,
under a bar of 0.96.

The launch kit preset

earshot kit init --preset launch places every effect against the music bed instead of at a fixed level. New kit
keys: bed_db, offset_ms (taps and knocks lead the cut, whoosh and swell peaks land after it), min_gap_ms,
width, and a mix block for the stop-down (the music steps down before a hit and comes back on it; no ducking).
Helpers for a mixer: kit.bed_level, kit.gain_db, kit.place, kit.space_run, kit.stereo_width,
kit.loud_lufs.

earshot fit, re-made against professional sound effects

A gesture model (tones plus air, with motion knobs), stereo and space kept per octave band, music beds stripped
before fitting, a time-shape gate and tonal knobs. Measured with a new replication benchmark on a private set of
licensed reference clips (no audio, no clip names and no per-clip models ship):

clips 0.3 0.4.0
dev (78), median CLAP 0.884 0.921
held-out (38), median CLAP 0.878 0.903
held-out (38), high-grade fits 7 14
fresh held-out (28), median CLAP 0.853 0.851

On the harder fresh set 0.4.0 is level on the median and ahead on the mean, the spectrogram gap and the grades; the
onset error and the number of passing takes got worse there. The known gaps are listed in CHANGELOG.md.

Full details: CHANGELOG.md,
docs/FIT.md.

Attached

  • earshot-0.4.mp4: the 0.4 launch film (35 s, 1080p60). Its sound effects come from the earshot bank via the
    launch kit; the one real recording in it is a CC0 clip shown next to its earshot re-make, and the music is a licensed
    track.