Skip to content

AnyAudio v0.4.0

Choose a tag to compare

@cloudoyx cloudoyx released this 19 Nov 11:03
· 2 commits to main since this release

AnyAudio v0.4.0

这一版加入了唱歌:Agent 按音符和歌词在本机合成人声,作为单独一轨进剪辑台。运行环境和声库按需下载,不打包进插件。

中文

唱歌

新增第 6 个工具 anyaudio_sing。音符四字段:[起始秒, 时长, 音高或 null, 歌词]。按休止自动分句、逐句合成;一个字唱多个音时,字写在第一个音符上,后面的音符歌词留空。合成结果落在独立人声轨上,可试听、调音量、逐句重生成。Agent 遇到唱歌需求时自动调用,无需点名。

本机合成用 DiffSinger 和绮萱声库,全程不联网。首次使用分三步:装运行环境(Python 和依赖,约 45 MB,声码器约 50 MB);从 GitHub、百度网盘或夸克网盘下载声库 zip(三处是同一个原包);在设置页填本地 zip 路径安装。显卡加速是可选增强,需额外下载约 216 MB 的组件。

实测:3 分钟的歌,CPU 约 247 秒,显卡约 28.5 秒,快约 8.7 倍。

引导与设置

首装引导从五步变六步,新增「装唱歌引擎」,放在「认识剪辑台」之前。设置页新增「唱歌」标签,可查看安装状态、选声库和推理设备、看下载进度。系统提示词和两个技能文档加入自动触发说明。

已知限制

音质由声库和调教决定,插件只提供安装渠道、接口和使用方式。唱歌声库只保证绮萱 v2.7.0 基本可用;其它声库接口开放,但不保证加载和效果。显卡加速依赖本机显卡与驱动,不兼容时重装唱歌环境即可回到 CPU。

安装

dsh plugin --profile desktop add dsh-any-audio@0.4.0

装完重启 DSH。需要 Node.js 22.19+(22.x)或 24+。


English

Singing

A sixth tool, anyaudio_sing, synthesises a real vocal on this machine from notes and lyrics and places it on its own track in the clip bay. A note is [startSec, durSec, midi|null, lyric]. Notes are split at rests and sung in sequence; for a drawn-out syllable, put the word on the first note and leave the rest empty. The result can be auditioned, gain-adjusted and regenerated line by line. The agent calls it automatically on singing requests.

Synthesis uses DiffSinger with the Qixuan voicebank, entirely offline. First use takes three steps: install the runtime (Python and dependencies, about 45 MB, plus a 50 MB vocoder); download the voicebank zip from GitHub, Baidu Drive or Quark Drive (the same archive everywhere); then install it from Settings by pasting the local path. GPU acceleration is optional and adds about 216 MB.

Measured: a three-minute song takes about 247 s on CPU and 28.5 s on GPU — roughly 8.7× faster.

Guide and Settings

The first-run guide grows from five steps to six, adding "install the singing engine" before the clip bay. A new Singing tab shows install status, voicebank and device selection, and download progress. The system prompt and both skills now describe the auto-trigger.

Known limitations

Vocal quality is set by the voicebank and tuning; the plugin only provides the install channel, interface and usage. Only Qixuan v2.7.0 is guaranteed to work; other banks are accepted but not guaranteed. GPU acceleration depends on local hardware and drivers; reinstalling the singing environment restores CPU if needed.

Install

dsh plugin --profile desktop add dsh-any-audio@0.4.0

Restart DSH afterwards. Requires Node.js 22.19+ (22.x) or 24+.