Skip to content

v0.2.1-beta.4

Choose a tag to compare

@jingyi0605 jingyi0605 released this 08 Oct 04:37
· 455 commits to main since this release

v0.2.1-beta.4

中文说明

@jingyi0605/codingns4dsh@0.2.1-beta.4 扩展全局智能助理(测试中),加入连续文字与实时语音交流、项目认知和形象管理,并完善终端分享、远程模型目录与移动端交互。DSH 兼容范围保持不变。

更新内容

  • 全局助理统一创建、对话、配置与重置入口;文字和语音共用持久历史,支持附件、工作区与会话查询、管理跟进和原生联网搜索,配置草稿统一保存。
  • 加入逐会话结构化索引、完成后的自动增量更新和最多三次的有限重试;分别显示执行状态、索引进度、材料版本及重试等待,保留严格证据校验。
  • 加入实时通话页、静音与扬声器控制、通话收起和悬浮字幕;聊天与通话详情按时间线展示正文和实际工具调用,挂断后保留文字记录,不保存原始录音。
  • 完善浏览器 TTS(文字转语音)与可选的本地 MOSS 播报、18 个预设音色及逐句流式播放;提供语音初始化向导、识别模型管理与下载进度、领域热词和诊断工具。
  • 加入统一形象插槽、鱼妞/鱼仔基本形象、第三方素材安装与真实预览、透明头像生成和裁剪;支持图片、宠物动作图集与 Live2D,引擎在确认许可后按需下载、校验并安装到插件自有目录。
  • 加入 macOS/Windows 系统级悬浮助理(测试中)、位置记忆和点击唤回主窗口的实现,避免原生与页面形象重复闪现;参考并改造 dsh-live2d-avatar 的原生伴随窗口代码。
  • 终端连接与屏幕按工作区常驻复用,保留卡片和子标签选择;支持日志卡片分享与悬浮预览,并修复关闭子终端后的标签残留和并发状态。
  • 修复 PeerHost 远程模型目录和外部模型缓存跨 Host 混用,按当前前台 Host 隔离模型选择与右栏路由。
  • 修复 Codex 运行中插话的协议参数和迟到响应处理;恢复 DSH 0.2.0-rc.2 的助理模型目录与管理根 Agent 能力。
  • 修复移动端右栏自动弹出和标签触摸滚动,改善 iPad PWA 顶部安全区及输入焦点,修复浏览器缺少 process 时的插件加载失败。
  • 完善 Stage0 自动编译与热重载,重载期间保留插件设置;修复完整测试的模块解析,并阻止 Python 字节码缓存进入 npm 包。

要求

  • Node.js >=22.19.0
  • DSH >=0.2.0-rc.2 <=0.2.1-alpha.1(已验证 0.2.1-alpha.1)
  • PATH 中有 pnpm
  • macOS / Linux / Windows;持久终端可选 tmux
  • 全局助理默认关闭,仍在测试中;实时语音需要 HTTPS 或 localhost、麦克风授权及识别资源。MOSS 需另行准备模型;Live2D 引擎在许可确认后按需安装。
  • Windows 系统悬浮需要已有 WebView2 Runtime;缺失时回退到页面形象。

已知限制

  • 系统悬浮窗口的完整双平台实机验收仍待完成;本次验证包含 macOS 独立隐藏进程测试及 Windows 代码契约检查。
  • 已有部分模型对话报错 Stream ended without finish reason 的反馈,原因仍待定位;全局助理暂不作为稳定能力承诺。

安装

dsh plugin --profile web add @jingyi0605/codingns4dsh@0.2.1-beta.4
dsh web

完整文档请查看 README 中文说明。

English

@jingyi0605/codingns4dsh@0.2.1-beta.4 expands the experimental global assistant with continuous text and real-time voice conversations, project awareness, and avatar management. It also improves terminal sharing, remote model catalogs, and mobile interactions. The DSH compatibility range remains unchanged.

Highlights

  • Unified assistant creation, conversations, configuration, and reset. Text and voice share persistent history, with attachments, workspace/session queries, management follow-ups, native web search, and a shared configuration draft.
  • Added structured per-session indexes, incremental updates after turns finish, and bounded retries with at most three attempts. Execution status, index progress, material versions, and retry waits are displayed separately while retaining strict evidence validation.
  • Added real-time call controls, mute and speaker toggles, minimized calls, and floating subtitles. Conversation and call details show text and actual tool calls in timeline order; transcripts remain after hang-up without storing raw recordings.
  • Improved browser TTS and optional local MOSS speech, including 18 preset voices and sentence-by-sentence streaming. Added voice setup, recognition model management, download progress, domain hotwords, and diagnostic tools.
  • Added shared avatar slots, built-in whale avatars, third-party asset installation and previews, transparent portraits, and cropping. Supports images, pet spritesheets, and Live2D, with the engine downloaded, verified, and installed into plugin-owned storage after license confirmation.
  • Added experimental macOS/Windows native floating assistants, position persistence, and main-window recall, while preventing duplicate page avatars from flashing. The native companion-window code is adapted from dsh-live2d-avatar.
  • Reuses terminal connections and screens per workspace while retaining card and sub-tab selections. Added log-card sharing and hover previews, and fixed stale tabs and concurrent state handling after closing child terminals.
  • Fixed cross-Host mixing of PeerHost model catalogs and external model caches. Model selection and right-sidebar routing now follow the active foreground Host.
  • Fixed Codex active-turn steering parameters and late responses. Restored assistant model catalogs and management root-agent capabilities on DSH 0.2.0-rc.2.
  • Fixed mobile right-sidebar reopening and tab touch scrolling, improved iPad PWA safe areas and input focus, and fixed plugin loading in browsers without process.
  • Improved Stage0 automatic compilation and hot reload while retaining plugin settings. Fixed module resolution in the full test suite and excluded Python bytecode caches from npm packages.

Requirements

  • Node.js >=22.19.0
  • DSH >=0.2.0-rc.2 <=0.2.1-alpha.1 (validated with 0.2.1-alpha.1)
  • pnpm on PATH
  • macOS / Linux / Windows; optional tmux for persistent terminals
  • The global assistant is disabled by default and remains experimental. Real-time voice requires HTTPS or localhost, microphone permission, and recognition resources. MOSS requires model setup; the Live2D engine is installed on demand after license confirmation.
  • Native floating assistants on Windows require an existing WebView2 Runtime; otherwise the page avatar is used.

Known limitations

  • Full native-window validation on both platforms remains pending. This release was checked with isolated hidden-process tests on macOS and code-contract checks for Windows.
  • Some model conversations have been reported to fail with Stream ended without finish reason; the cause remains under investigation. The global assistant is not yet a stable capability.

Installation

dsh plugin --profile web add @jingyi0605/codingns4dsh@0.2.1-beta.4
dsh web

Complete documentation: README.