Repository navigation
Releases: 5258MF/ninfer-rtx3060-27b
Release list
Swift 1.5 IQ2S / IQ3XXS Shared Source 0.1.4
Swift 1.5 IQ2S / IQ3XXS 共用源码 0.1.4
这次重新发布包含最新 BAT 与容量逻辑的完整源码,沿用 Swift 0.1.4 / Bonsai2 0.1.5 版本号。标签与附件均更新到提交 7fdbbb76d65f69ba890bc135dd7529cd81dd9d6f。
- BAT 转发参数、保留退出码;菜单支持数字选项,名称仍兼容,回车保留配置,原 0关/1开语义不变。
- 驻留可选
recommended、auto或当前范围内的手动 token 数。推荐值不是硬上限;实时显存、匹配组合校准与逻辑上下文共同决定允许范围,启动前再次检查。8G 采用包含桌面和其他负载的整卡8GiB预算。 - 不恢复固定 SYS、36K/平分或32K输出分区。完整前缀、检索与实际输出由引擎逐请求分配;API上界不等于独占输出显存。本地DSH自动同步不进入通用启动包。
- 保留公开模型路径覆盖、启动参数与非交互dryrun;IQ3不依赖B机目录或默认测试队列。Bonsai缺模型时不再检查未初始化的KV/容量,避免误报“驻留0”。
验证:140项离线容量/菜单/启动前复查,16个相关PS脚本语法,8组Graph预览、4组数字向导与越界拒绝及源码哈希通过。本次发布未重新加载GPU;实机依据为交接记录中的7入口auto短问答、约7.2K输入预填充和CPU看图,不是满上下文或32K/64K长输出验收。各模型独立校准,未匹配显卡/组合继续采用保守估算。
中英文主README保留全部10个已测配置的decode、2K/8K/16K prefill与TTFT。IQ3XXS PPL为4.495637819904494,速度表引用2026-10-05记录,不当作新默认窗口的重新测速。改动与校准短测点 · 原始评分/性能报告。
IQ2S与IQ3XXS共用 swift15/engine/,启动器分别位于 oneclick-iq2s/、oneclick-iq3xxs/。CPU视觉与Graph控制保留。IQ3XXS仍为开发配置,未发布独立网盘包;IQ2S网盘懒人包仍为0.1.2。
附件只包含 swift15/ 完整源码及公开启动器,不含模型、EXE/DLL、日志或私人会话。网盘包和链接不替换。
附件 SHA256:998299c1c4121064715d1d16879ac18bca00f1e88f84cf9633ec9f84c43655a5
These source Releases replace the withdrawn versions with the latest BAT/capacity fixes. Numbered menus separate recommended, auto and manual resident capacity. Live VRAM, matching model-specific calibration and logical context bound each selection; startup rechecks the budget. The 8G profile accounts for whole-card occupancy. Actual prefix/retrieval/output allocation remains request-based; generic launchers do not sync local DSH settings. Portable model overrides, argument preservation and noninteractive dry-run are retained. The Bonsai missing-model path no longer checks uninitialized KV/capacity variables.
Validation: 140 offline checks, 16 related PowerShell syntax checks, 8 Graph previews, 4 numeric-wizard/bound checks and source hashes passed. No GPU rerun was performed for publication. Recorded GPU checks are short-request, prefill and CPU-vision tests, not full-context or 32K/64K output qualification. Performance/PPL tables retain their original measurements and limitations.
IQ2S/IQ3XXS share the Swift engine with separate launcher profiles. IQ3XXS remains developmental; the IQ2S cloud package remains 0.1.2.
The asset contains only swift15/ sources and public launchers, without weights, runtime binaries/DLLs, logs or private sessions. Cloud downloads are unchanged.
Bonsai2 8G / 12G Shared Source 0.1.5
Bonsai2 8G / 12G 共用源码 0.1.5
这次重新发布包含最新 BAT 与容量逻辑的完整源码,沿用 Swift 0.1.4 / Bonsai2 0.1.5 版本号。标签与附件均更新到提交 7fdbbb76d65f69ba890bc135dd7529cd81dd9d6f。
- BAT 转发参数、保留退出码;菜单支持数字选项,名称仍兼容,回车保留配置,原 0关/1开语义不变。
- 驻留可选
recommended、auto或当前范围内的手动 token 数。推荐值不是硬上限;实时显存、匹配组合校准与逻辑上下文共同决定允许范围,启动前再次检查。8G 采用包含桌面和其他负载的整卡8GiB预算。 - 不恢复固定 SYS、36K/平分或32K输出分区。完整前缀、检索与实际输出由引擎逐请求分配;API上界不等于独占输出显存。本地DSH自动同步不进入通用启动包。
- 保留公开模型路径覆盖、启动参数与非交互dryrun;IQ3不依赖B机目录或默认测试队列。Bonsai缺模型时不再检查未初始化的KV/容量,避免误报“驻留0”。
验证:140项离线容量/菜单/启动前复查,16个相关PS脚本语法,8组Graph预览、4组数字向导与越界拒绝及源码哈希通过。本次发布未重新加载GPU;实机依据为交接记录中的7入口auto短问答、约7.2K输入预填充和CPU看图,不是满上下文或32K/64K长输出验收。各模型独立校准,未匹配显卡/组合继续采用保守估算。
中英文主README保留全部10个已测配置的decode、2K/8K/16K prefill与TTFT。IQ3XXS PPL为4.495637819904494,速度表引用2026-10-05记录,不当作新默认窗口的重新测速。改动与校准短测点 · 原始评分/性能报告。
8G与12G共用 bonsai2/engine/,分别提供 oneclick-8g/、oneclick-12g/。CPU视觉/检索和Graph控制、旧KV页回收修复保留;回收开关在8G kvrk4启动器启用,其余构建默认关闭。8G/12G网盘懒人包仍为0.1.3。
附件只包含 bonsai2/ 完整源码及公开启动器,不含模型、EXE/DLL、日志或私人会话。网盘包和链接不替换。
附件 SHA256:cbea41a2823105f845619731fdebdd73da909ff94097307617d93eac03e903ee
These source Releases replace the withdrawn versions with the latest BAT/capacity fixes. Numbered menus separate recommended, auto and manual resident capacity. Live VRAM, matching model-specific calibration and logical context bound each selection; startup rechecks the budget. The 8G profile accounts for whole-card occupancy. Actual prefix/retrieval/output allocation remains request-based; generic launchers do not sync local DSH settings. Portable model overrides, argument preservation and noninteractive dry-run are retained. The Bonsai missing-model path no longer checks uninitialized KV/capacity variables.
Validation: 140 offline checks, 16 related PowerShell syntax checks, 8 Graph previews, 4 numeric-wizard/bound checks and source hashes passed. No GPU rerun was performed for publication. Recorded GPU checks are short-request, prefill and CPU-vision tests, not full-context or 32K/64K output qualification. Performance/PPL tables retain their original measurements and limitations.
8G/12G share the Bonsai2 engine with separate launcher profiles. CPU vision/retrieval, Graph controls and the opt-in old-KV-page eviction fix are retained. Cloud packages remain 0.1.3.
The asset contains only bonsai2/ sources and public launchers, without weights, runtime binaries/DLLs, logs or private sessions. Cloud downloads are unchanged.
Swift 1.5 IQ2S / IQ3XXS Shared Source 0.1.3
Swift 1.5 IQ2S / IQ3XXS 共用源码 0.1.3
本版本将 Swift 1.5 的 IQ2_S 与 IQ3_XXS 源码明确整理为一套共用引擎。两种量化格式使用同一份 swift15/engine/,不需要复制引擎源码。现有 IQ2S 启动器源码位于 oneclick-iq2s/;IQ3XXS 懒人包和启动器尚未发布。
更新内容:
- 合入 CPU 视觉编码路径:可选 OpenBLAS 加速、自动线程校准和缓存;OpenBLAS 不可用时回退到参考 CPU 实现。
- 同一引擎源码覆盖 IQ2_S / IQ3_XXS 格式映射和对应 GPU 内核。
- 源码附件只含 swift15/ 目录,不含模型、引擎二进制或运行时 DLL。
验证记录:Windows sm_86 Swift 构建通过;CPU 后端 7 项单测通过;RTX 3060 12GB 上 IQ2S / IQ3XXS 的看图冒烟测试记录通过。这些结果不代表所有图片、CPU 或长上下文配置都已全面验证。
当前 IQ2S 网盘懒人包仍为 0.1.2;本 Release 不更新懒人包。IQ3XXS 懒人包会在后续单独发布。
Swift 1.5 IQ2S / IQ3XXS Shared Source 0.1.3
IQ2_S and IQ3_XXS share one Swift 1.5 engine source tree at swift15/engine/. The current IQ2S launcher source is in oneclick-iq2s/; an IQ3XXS launcher and one-click package are not included yet.
This source update adds CPU vision encoding with optional OpenBLAS acceleration, automatic thread calibration and caching, and a reference CPU fallback. The source archive contains only the swift15/ directory, with no model weights, engine binaries, or runtime DLLs.
Verification records show a passing Windows sm_86 Swift build, seven CPU-backend unit tests, and IQ2S/IQ3XXS image smoke tests on an RTX 3060 12GB. This does not qualify every image, CPU, or long-context configuration.
The existing IQ2S netdisk package remains version 0.1.2. This release does not update the one-click packages; the IQ3XXS package will be published separately later.
Bonsai2 8G / 12G Shared Source 0.1.4
Bonsai2 8G / 12G 共用源码 0.1.4
此版本把 12G 启动器源码目录从 oneclick/ 明确改名为 oneclick-12g/,与 oneclick-8g/ 对称。8G 和 12G 仍共用 bonsai2/engine/;本次只调整源码目录名、文档链接和源码版本,不改引擎代码、启动参数或网盘懒人包。
源码附件只包含 bonsai2/ 目录,不含模型、引擎二进制、运行时 DLL 或日志。8G / 12G 懒人包仍为 0.1.3。
验证:README 本地链接检查通过;8G / 12G 启动器 PowerShell 脚本语法检查通过;源码 ZIP CRC 和内容检查通过。本次没有重新编译引擎,因为引擎源码未变。
Bonsai2 Shared 8G / 12G Source 0.1.4
The 12G launcher source directory is now named oneclick-12g/, alongside oneclick-8g/. Both capacity builds continue to share bonsai2/engine/. This release changes source-tree naming, documentation links, and the source version only; it does not change engine code, launch settings, or the netdisk packages.
The source asset contains only the bonsai2/ directory and no model files, engine binaries, runtime DLLs, or logs. Both one-click packages remain version 0.1.3.
Verification: local README links, both launcher PowerShell syntax checks, and source archive CRC/content checks passed. The engine was not rebuilt because its source did not change.
Swift 1.5 Q2S Source 0.1.2
Swift 1.5 Q2S source release 0.1.2
This archive contains the Swift 1.5 Q2S source tree and its model-specific documentation.
- KVMem now counts the fully rendered system, developer, and tool prefix for each request. At a 256K logical context it targets 32K–36K retrieval (36K preferred); at 128K it targets 16K–18K (18K preferred). Remaining resident capacity is available to output, with an 8K minimum reserve.
- Harness contextWindow and maxTokens can be configured before the first request; the server adjusts each request to its actual prefix.
- Fixed a shared/private prefix-cache indexing defect that could crash when shared slots outnumbered private slots. Added a regression case and recalibrated image-window accounting.
- dsh standard and minimal presets completed file-read/write/read-back tool round trips.
Verification: Windows sm86 incremental build passed; resource-manager regression suite passed; 714 launcher/policy checks and six full launcher dry runs passed. Long output at the maximum window and a real 8GB GPU were not requalified in this release.
Swift 1.5 Q2S Source 0.1.1
源码版本 0.1.1,包含 Swift 1.5 Q2S 的完整引擎工程、构建脚本、启动器和验收脚本。
- 修复启动完成判断、缩窗后的客户端限制同步、思考预算联动和失败退出码。
- 验收以 0/1/2 区分通过、失败和未确认,补齐实际输出封顶、工具结果回传、Messages/Responses 与看图。
- Windows PowerShell 5.1 模拟回归 48 项通过;RTX 3060 12GB 两套小窗口实机验收通过。此次版本标记更新没有重编译引擎,也未重测满 256K/32K、速度或质量。
- Swift 包自检进入脚本后确定默认根目录,避免默认目录为空导致检查无法运行。
- 网盘仍为此前上传的 0.1.0 包;源码 0.1.1 不代表旧网盘包已自动更新。
请选择附件 ninfer-swift15-q2s-source-0.1.1.zip,解压后只有 swift15/ 目录,不包含另一模型源码。GitHub 自动生成的 Source code 归档仍为整个仓库快照。
提交:6b3d1ac2013bb3e150205c4760e7128e0ea8a2c9
附件大小:15,999,738 字节;文件数:2529。
SHA256:5849aeaf0a7c5c5e0131923a288a59a17b9d45c1ad83cc04786905ccbefc48a2
版本记录:CHANGELOG。
English: Complete Swift 1.5 Q2S source, build and launcher scripts for 0.1.1, including startup and verification fixes. The named asset contains only swift15/; existing 0.1.0 cloud packages remain unchanged. Engine binaries and model quantization were not changed.
Swift 1.5 Q2S Source 0.1.0
中文
这是 Swift 1.5 Q2S 的 0.1.0 源码发布。请下载附件 ninfer-swift15-q2s-source-0.1.0.zip,内容只有 swift15/ 源码、构建入口、启动器和模型转换工具。
此附件不含 Bonsai2 源码、模型权重或懒人包运行二进制。Bonsai2 12G 有单独的 源码 Release。懒人包下载链接见项目首页。
GitHub 自动生成的 Source code (zip) / Source code (tar.gz) 是整个仓库快照;需要单独的 Swift 源码时,请选择上面的命名附件。
English
Swift 1.5 Q2S source release 0.1.0. Download the attached ninfer-swift15-q2s-source-0.1.0.zip. It contains only the swift15/ source tree, build entry point, launcher, and model-conversion tools.
This asset does not include Bonsai2 source, model weights, or one-click runtime binaries. Bonsai2 12G has a separate source release. One-click package links are on the project home.
GitHub's automatically generated Source code (zip) / Source code (tar.gz) contain a snapshot of the entire repository. For Swift-only source, use the named asset above.
Bonsai2 8G / 12G Source 0.1.3
Bonsai2 source release 0.1.3 (8G and 12G)
The 8G and 12G packages share this Bonsai2 engine source tree. This archive contains that model-family source and the 8G/12G documentation.
- KVMem allocates each request from the fully rendered system, developer, and tool prefix. Retrieval targets 32K–36K at a 256K logical context and 16K–18K at 128K. Remaining resident capacity goes to output, with at least 8K reserved.
- Harness contextWindow and maxTokens are known before the first request; actual per-request output is capped after counting the prompt.
- dsh standard/minimal presets completed tool round trips on both capacity configurations. At 80K resident capacity, the 12G output allowance rose from 32K to about 37.6K/43.6K; short-task timing was effectively unchanged.
- IQ3XXS compatibility check: the uploaded model is NInfer v3 while this Bonsai engine currently reads NInfer v2, so it fails at artifact-header validation before weight loading.
Verification: the three Windows sm86 Bonsai build targets passed, allocation and engine regression checks passed, and all six launcher dry runs passed. The 8G tests used an RTX 3060 12GB with a reduced capacity budget, not a physical 8GB card. Long-history recall at very small resident windows remains limited.
Bonsai2 8G / 12G Source 0.1.2
Bonsai2 0.1.2 完整源码(8G / 12G 共用引擎)
KVMem 将 FP32 检索索引和 BF16 查询暂存迁到内存,CPU 分块打分。同容量显存约减少 401–404 MiB,生成速度基本持平,短提示词读入略慢。
窗口按 Swift 1.5 默认逻辑分配:先按空闲显存预算总驻留容量,再分配回答预留;自动回答达到 16K(8G rk8v4)/32K(其他 Bonsai 模式)上限后,余量全部给历史。手动回答长度保留。
- 8G 和 12G 共用完整 engine/;提供 oneclick/(12G)与 oneclick-8g/(8G)启动器、配置、验收源码。
- 构建默认 int8/rk8v4;设置 NINFER_RK4_SM86=ON 构建 8G rk4v4,使用独立 build-rk4/。
- 两个 CUDA 构建、FP64 CPU 打分 oracle、GPU/主机索引精确对照、部分块、快照恢复、Graph 重放通过。
- 四种 KV 配置的小窗口功能与扩大窗口冒烟通过,覆盖工具往返、Messages/Responses、图片和连续解码。
- 12G 252,552 token 三处藏针与两轮续问通过。8G 同容量下 CPU 与原 GPU 路径首次均把 A 答成 C,超长召回不能算通过。
- 本轮未重新测完整 16K/32K 长输出、困惑度或真实 8GB 硬件;旧 KV 三项历史断言失败不计入通过。
Swift 1.5 保持 0.1.1;本附件仅含 Bonsai2 源码,不含 Swift、模型、EXE、DLL、私人设置或测试日志。现有网盘链接仍为旧包,新 0.1.2 懒人包等待用户上传。
English: complete shared Bonsai2 sources for 8G/12G, with CPU retrieval and the Swift default window policy. About 400 MiB VRAM saved at the same capacity, with unchanged decode performance. The 12G 252K retrieval test passed; the 8G long-retrieval limitation is explicitly reported.
Source commit: f7090b9
Source ZIP SHA256: ed7db1cb52fea1f0fa218369928f42039737a4215be5a30206cbb6f576723b95
Bonsai2 12G Source 0.1.1
源码版本 0.1.1,包含 Bonsai2 12G 的完整引擎工程、构建脚本、启动器和验收脚本。
- 修复启动完成判断、缩窗后的客户端限制同步、思考预算联动和失败退出码。
- 验收以 0/1/2 区分通过、失败和未确认,补齐实际输出封顶、工具结果回传、Messages/Responses 与看图。
- Windows PowerShell 5.1 模拟回归 48 项通过;RTX 3060 12GB 两套小窗口实机验收通过。此次版本标记更新没有重编译引擎,也未重测满 256K/32K、速度或质量。
- 网盘仍为此前上传的 0.1.0 包;源码 0.1.1 不代表旧网盘包已自动更新。
请选择附件 ninfer-bonsai2-12g-source-0.1.1.zip,解压后只有 bonsai2-12g/ 目录,不包含另一模型源码。GitHub 自动生成的 Source code 归档仍为整个仓库快照。
提交:6b3d1ac2013bb3e150205c4760e7128e0ea8a2c9
附件大小:10,533,566 字节;文件数:1504。
SHA256:ab802be45257c2ed73ec29d07b9ef481186049e66fe80bbb320233f2ea33c7ed
版本记录:CHANGELOG。
English: Complete Bonsai2 12G source, build and launcher scripts for 0.1.1, including startup and verification fixes. The named asset contains only bonsai2-12g/; existing 0.1.0 cloud packages remain unchanged. Engine binaries and model quantization were not changed.