Skip to content

Releases: 5258MF/ninfer-rtx3060-27b

Swift 1.5 IQ2S / IQ3XXS Shared Source 0.1.4

Choose a tag to compare

@5258MF 5258MF released this 06 Oct 08:22

Swift 1.5 IQ2S / IQ3XXS 共用源码 0.1.4

这次重新发布包含最新 BAT 与容量逻辑的完整源码,沿用 Swift 0.1.4 / Bonsai2 0.1.5 版本号。标签与附件均更新到提交 7fdbbb76d65f69ba890bc135dd7529cd81dd9d6f。

  • BAT 转发参数、保留退出码;菜单支持数字选项,名称仍兼容,回车保留配置,原 0关/1开语义不变。
  • 驻留可选 recommended、auto 或当前范围内的手动 token 数。推荐值不是硬上限;实时显存、匹配组合校准与逻辑上下文共同决定允许范围,启动前再次检查。8G 采用包含桌面和其他负载的整卡8GiB预算。
  • 不恢复固定 SYS、36K/平分或32K输出分区。完整前缀、检索与实际输出由引擎逐请求分配;API上界不等于独占输出显存。本地DSH自动同步不进入通用启动包。
  • 保留公开模型路径覆盖、启动参数与非交互dryrun;IQ3不依赖B机目录或默认测试队列。Bonsai缺模型时不再检查未初始化的KV/容量,避免误报“驻留0”。

验证:140项离线容量/菜单/启动前复查,16个相关PS脚本语法,8组Graph预览、4组数字向导与越界拒绝及源码哈希通过。本次发布未重新加载GPU;实机依据为交接记录中的7入口auto短问答、约7.2K输入预填充和CPU看图,不是满上下文或32K/64K长输出验收。各模型独立校准,未匹配显卡/组合继续采用保守估算。

中英文主README保留全部10个已测配置的decode、2K/8K/16K prefill与TTFT。IQ3XXS PPL为4.495637819904494,速度表引用2026-10-05记录,不当作新默认窗口的重新测速。改动与校准短测点 · 原始评分/性能报告。

IQ2S与IQ3XXS共用 swift15/engine/,启动器分别位于 oneclick-iq2s/、oneclick-iq3xxs/。CPU视觉与Graph控制保留。IQ3XXS仍为开发配置,未发布独立网盘包;IQ2S网盘懒人包仍为0.1.2。

附件只包含 swift15/ 完整源码及公开启动器,不含模型、EXE/DLL、日志或私人会话。网盘包和链接不替换。

附件 SHA256:998299c1c4121064715d1d16879ac18bca00f1e88f84cf9633ec9f84c43655a5


These source Releases replace the withdrawn versions with the latest BAT/capacity fixes. Numbered menus separate recommended, auto and manual resident capacity. Live VRAM, matching model-specific calibration and logical context bound each selection; startup rechecks the budget. The 8G profile accounts for whole-card occupancy. Actual prefix/retrieval/output allocation remains request-based; generic launchers do not sync local DSH settings. Portable model overrides, argument preservation and noninteractive dry-run are retained. The Bonsai missing-model path no longer checks uninitialized KV/capacity variables.

Validation: 140 offline checks, 16 related PowerShell syntax checks, 8 Graph previews, 4 numeric-wizard/bound checks and source hashes passed. No GPU rerun was performed for publication. Recorded GPU checks are short-request, prefill and CPU-vision tests, not full-context or 32K/64K output qualification. Performance/PPL tables retain their original measurements and limitations.

IQ2S/IQ3XXS share the Swift engine with separate launcher profiles. IQ3XXS remains developmental; the IQ2S cloud package remains 0.1.2.

The asset contains only swift15/ sources and public launchers, without weights, runtime binaries/DLLs, logs or private sessions. Cloud downloads are unchanged.

Bonsai2 8G / 12G Shared Source 0.1.5

Choose a tag to compare

@5258MF 5258MF released this 06 Oct 08:22

Bonsai2 8G / 12G 共用源码 0.1.5

这次重新发布包含最新 BAT 与容量逻辑的完整源码,沿用 Swift 0.1.4 / Bonsai2 0.1.5 版本号。标签与附件均更新到提交 7fdbbb76d65f69ba890bc135dd7529cd81dd9d6f。

  • BAT 转发参数、保留退出码;菜单支持数字选项,名称仍兼容,回车保留配置,原 0关/1开语义不变。
  • 驻留可选 recommended、auto 或当前范围内的手动 token 数。推荐值不是硬上限;实时显存、匹配组合校准与逻辑上下文共同决定允许范围,启动前再次检查。8G 采用包含桌面和其他负载的整卡8GiB预算。
  • 不恢复固定 SYS、36K/平分或32K输出分区。完整前缀、检索与实际输出由引擎逐请求分配;API上界不等于独占输出显存。本地DSH自动同步不进入通用启动包。
  • 保留公开模型路径覆盖、启动参数与非交互dryrun;IQ3不依赖B机目录或默认测试队列。Bonsai缺模型时不再检查未初始化的KV/容量,避免误报“驻留0”。

验证:140项离线容量/菜单/启动前复查,16个相关PS脚本语法,8组Graph预览、4组数字向导与越界拒绝及源码哈希通过。本次发布未重新加载GPU;实机依据为交接记录中的7入口auto短问答、约7.2K输入预填充和CPU看图,不是满上下文或32K/64K长输出验收。各模型独立校准,未匹配显卡/组合继续采用保守估算。

中英文主README保留全部10个已测配置的decode、2K/8K/16K prefill与TTFT。IQ3XXS PPL为4.495637819904494,速度表引用2026-10-05记录,不当作新默认窗口的重新测速。改动与校准短测点 · 原始评分/性能报告。

8G与12G共用 bonsai2/engine/,分别提供 oneclick-8g/、oneclick-12g/。CPU视觉/检索和Graph控制、旧KV页回收修复保留;回收开关在8G kvrk4启动器启用,其余构建默认关闭。8G/12G网盘懒人包仍为0.1.3。

附件只包含 bonsai2/ 完整源码及公开启动器,不含模型、EXE/DLL、日志或私人会话。网盘包和链接不替换。

附件 SHA256:cbea41a2823105f845619731fdebdd73da909ff94097307617d93eac03e903ee


These source Releases replace the withdrawn versions with the latest BAT/capacity fixes. Numbered menus separate recommended, auto and manual resident capacity. Live VRAM, matching model-specific calibration and logical context bound each selection; startup rechecks the budget. The 8G profile accounts for whole-card occupancy. Actual prefix/retrieval/output allocation remains request-based; generic launchers do not sync local DSH settings. Portable model overrides, argument preservation and noninteractive dry-run are retained. The Bonsai missing-model path no longer checks uninitialized KV/capacity variables.

Validation: 140 offline checks, 16 related PowerShell syntax checks, 8 Graph previews, 4 numeric-wizard/bound checks and source hashes passed. No GPU rerun was performed for publication. Recorded GPU checks are short-request, prefill and CPU-vision tests, not full-context or 32K/64K output qualification. Performance/PPL tables retain their original measurements and limitations.

8G/12G share the Bonsai2 engine with separate launcher profiles. CPU vision/retrieval, Graph controls and the opt-in old-KV-page eviction fix are retained. Cloud packages remain 0.1.3.

The asset contains only bonsai2/ sources and public launchers, without weights, runtime binaries/DLLs, logs or private sessions. Cloud downloads are unchanged.

Swift 1.5 IQ2S / IQ3XXS Shared Source 0.1.3

Choose a tag to compare

@5258MF 5258MF released this 05 Oct 10:01

Swift 1.5 IQ2S / IQ3XXS 共用源码 0.1.3

本版本将 Swift 1.5 的 IQ2_S 与 IQ3_XXS 源码明确整理为一套共用引擎。两种量化格式使用同一份 swift15/engine/,不需要复制引擎源码。现有 IQ2S 启动器源码位于 oneclick-iq2s/;IQ3XXS 懒人包和启动器尚未发布。

更新内容:

  • 合入 CPU 视觉编码路径:可选 OpenBLAS 加速、自动线程校准和缓存;OpenBLAS 不可用时回退到参考 CPU 实现。
  • 同一引擎源码覆盖 IQ2_S / IQ3_XXS 格式映射和对应 GPU 内核。
  • 源码附件只含 swift15/ 目录,不含模型、引擎二进制或运行时 DLL。

验证记录:Windows sm_86 Swift 构建通过;CPU 后端 7 项单测通过;RTX 3060 12GB 上 IQ2S / IQ3XXS 的看图冒烟测试记录通过。这些结果不代表所有图片、CPU 或长上下文配置都已全面验证。

当前 IQ2S 网盘懒人包仍为 0.1.2;本 Release 不更新懒人包。IQ3XXS 懒人包会在后续单独发布。


Swift 1.5 IQ2S / IQ3XXS Shared Source 0.1.3

IQ2_S and IQ3_XXS share one Swift 1.5 engine source tree at swift15/engine/. The current IQ2S launcher source is in oneclick-iq2s/; an IQ3XXS launcher and one-click package are not included yet.

This source update adds CPU vision encoding with optional OpenBLAS acceleration, automatic thread calibration and caching, and a reference CPU fallback. The source archive contains only the swift15/ directory, with no model weights, engine binaries, or runtime DLLs.

Verification records show a passing Windows sm_86 Swift build, seven CPU-backend unit tests, and IQ2S/IQ3XXS image smoke tests on an RTX 3060 12GB. This does not qualify every image, CPU, or long-context configuration.

The existing IQ2S netdisk package remains version 0.1.2. This release does not update the one-click packages; the IQ3XXS package will be published separately later.

Bonsai2 8G / 12G Shared Source 0.1.4

Choose a tag to compare

@5258MF 5258MF released this 05 Oct 10:08

Bonsai2 8G / 12G 共用源码 0.1.4

此版本把 12G 启动器源码目录从 oneclick/ 明确改名为 oneclick-12g/,与 oneclick-8g/ 对称。8G 和 12G 仍共用 bonsai2/engine/;本次只调整源码目录名、文档链接和源码版本,不改引擎代码、启动参数或网盘懒人包。

源码附件只包含 bonsai2/ 目录,不含模型、引擎二进制、运行时 DLL 或日志。8G / 12G 懒人包仍为 0.1.3。

验证:README 本地链接检查通过;8G / 12G 启动器 PowerShell 脚本语法检查通过;源码 ZIP CRC 和内容检查通过。本次没有重新编译引擎,因为引擎源码未变。


Bonsai2 Shared 8G / 12G Source 0.1.4

The 12G launcher source directory is now named oneclick-12g/, alongside oneclick-8g/. Both capacity builds continue to share bonsai2/engine/. This release changes source-tree naming, documentation links, and the source version only; it does not change engine code, launch settings, or the netdisk packages.

The source asset contains only the bonsai2/ directory and no model files, engine binaries, runtime DLLs, or logs. Both one-click packages remain version 0.1.3.

Verification: local README links, both launcher PowerShell syntax checks, and source archive CRC/content checks passed. The engine was not rebuilt because its source did not change.

Swift 1.5 Q2S Source 0.1.2

Choose a tag to compare

@5258MF 5258MF released this 04 Oct 21:51

Swift 1.5 Q2S source release 0.1.2

This archive contains the Swift 1.5 Q2S source tree and its model-specific documentation.

  • KVMem now counts the fully rendered system, developer, and tool prefix for each request. At a 256K logical context it targets 32K–36K retrieval (36K preferred); at 128K it targets 16K–18K (18K preferred). Remaining resident capacity is available to output, with an 8K minimum reserve.
  • Harness contextWindow and maxTokens can be configured before the first request; the server adjusts each request to its actual prefix.
  • Fixed a shared/private prefix-cache indexing defect that could crash when shared slots outnumbered private slots. Added a regression case and recalibrated image-window accounting.
  • dsh standard and minimal presets completed file-read/write/read-back tool round trips.

Verification: Windows sm86 incremental build passed; resource-manager regression suite passed; 714 launcher/policy checks and six full launcher dry runs passed. Long output at the maximum window and a real 8GB GPU were not requalified in this release.

Swift 1.5 Q2S Source 0.1.1

Choose a tag to compare

@5258MF 5258MF released this 04 Oct 11:10

源码版本 0.1.1,包含 Swift 1.5 Q2S 的完整引擎工程、构建脚本、启动器和验收脚本。

  • 修复启动完成判断、缩窗后的客户端限制同步、思考预算联动和失败退出码。
  • 验收以 0/1/2 区分通过、失败和未确认,补齐实际输出封顶、工具结果回传、Messages/Responses 与看图。
  • Windows PowerShell 5.1 模拟回归 48 项通过;RTX 3060 12GB 两套小窗口实机验收通过。此次版本标记更新没有重编译引擎,也未重测满 256K/32K、速度或质量。
  • Swift 包自检进入脚本后确定默认根目录,避免默认目录为空导致检查无法运行。
  • 网盘仍为此前上传的 0.1.0 包;源码 0.1.1 不代表旧网盘包已自动更新。

请选择附件 ninfer-swift15-q2s-source-0.1.1.zip,解压后只有 swift15/ 目录,不包含另一模型源码。GitHub 自动生成的 Source code 归档仍为整个仓库快照。

提交:6b3d1ac2013bb3e150205c4760e7128e0ea8a2c9
附件大小:15,999,738 字节;文件数:2529。
SHA256:5849aeaf0a7c5c5e0131923a288a59a17b9d45c1ad83cc04786905ccbefc48a2

版本记录:CHANGELOG。

English: Complete Swift 1.5 Q2S source, build and launcher scripts for 0.1.1, including startup and verification fixes. The named asset contains only swift15/; existing 0.1.0 cloud packages remain unchanged. Engine binaries and model quantization were not changed.

Swift 1.5 Q2S Source 0.1.0

Choose a tag to compare

@5258MF 5258MF released this 04 Oct 05:28

中文

这是 Swift 1.5 Q2S 的 0.1.0 源码发布。请下载附件 ninfer-swift15-q2s-source-0.1.0.zip,内容只有 swift15/ 源码、构建入口、启动器和模型转换工具。

此附件不含 Bonsai2 源码、模型权重或懒人包运行二进制。Bonsai2 12G 有单独的 源码 Release。懒人包下载链接见项目首页。

GitHub 自动生成的 Source code (zip) / Source code (tar.gz) 是整个仓库快照;需要单独的 Swift 源码时,请选择上面的命名附件。

English

Swift 1.5 Q2S source release 0.1.0. Download the attached ninfer-swift15-q2s-source-0.1.0.zip. It contains only the swift15/ source tree, build entry point, launcher, and model-conversion tools.

This asset does not include Bonsai2 source, model weights, or one-click runtime binaries. Bonsai2 12G has a separate source release. One-click package links are on the project home.

GitHub's automatically generated Source code (zip) / Source code (tar.gz) contain a snapshot of the entire repository. For Swift-only source, use the named asset above.

Bonsai2 8G / 12G Source 0.1.3

Choose a tag to compare

@5258MF 5258MF released this 04 Oct 21:51

Bonsai2 source release 0.1.3 (8G and 12G)

The 8G and 12G packages share this Bonsai2 engine source tree. This archive contains that model-family source and the 8G/12G documentation.

  • KVMem allocates each request from the fully rendered system, developer, and tool prefix. Retrieval targets 32K–36K at a 256K logical context and 16K–18K at 128K. Remaining resident capacity goes to output, with at least 8K reserved.
  • Harness contextWindow and maxTokens are known before the first request; actual per-request output is capped after counting the prompt.
  • dsh standard/minimal presets completed tool round trips on both capacity configurations. At 80K resident capacity, the 12G output allowance rose from 32K to about 37.6K/43.6K; short-task timing was effectively unchanged.
  • IQ3XXS compatibility check: the uploaded model is NInfer v3 while this Bonsai engine currently reads NInfer v2, so it fails at artifact-header validation before weight loading.

Verification: the three Windows sm86 Bonsai build targets passed, allocation and engine regression checks passed, and all six launcher dry runs passed. The 8G tests used an RTX 3060 12GB with a reduced capacity budget, not a physical 8GB card. Long-history recall at very small resident windows remains limited.

Bonsai2 8G / 12G Source 0.1.2

Choose a tag to compare

@5258MF 5258MF released this 04 Oct 15:52

Bonsai2 0.1.2 完整源码(8G / 12G 共用引擎)

KVMem 将 FP32 检索索引和 BF16 查询暂存迁到内存,CPU 分块打分。同容量显存约减少 401–404 MiB,生成速度基本持平,短提示词读入略慢。
窗口按 Swift 1.5 默认逻辑分配:先按空闲显存预算总驻留容量,再分配回答预留;自动回答达到 16K(8G rk8v4)/32K(其他 Bonsai 模式)上限后,余量全部给历史。手动回答长度保留。

  • 8G 和 12G 共用完整 engine/;提供 oneclick/(12G)与 oneclick-8g/(8G)启动器、配置、验收源码。
  • 构建默认 int8/rk8v4;设置 NINFER_RK4_SM86=ON 构建 8G rk4v4,使用独立 build-rk4/。
  • 两个 CUDA 构建、FP64 CPU 打分 oracle、GPU/主机索引精确对照、部分块、快照恢复、Graph 重放通过。
  • 四种 KV 配置的小窗口功能与扩大窗口冒烟通过,覆盖工具往返、Messages/Responses、图片和连续解码。
  • 12G 252,552 token 三处藏针与两轮续问通过。8G 同容量下 CPU 与原 GPU 路径首次均把 A 答成 C,超长召回不能算通过。
  • 本轮未重新测完整 16K/32K 长输出、困惑度或真实 8GB 硬件;旧 KV 三项历史断言失败不计入通过。

Swift 1.5 保持 0.1.1;本附件仅含 Bonsai2 源码,不含 Swift、模型、EXE、DLL、私人设置或测试日志。现有网盘链接仍为旧包,新 0.1.2 懒人包等待用户上传。

English: complete shared Bonsai2 sources for 8G/12G, with CPU retrieval and the Swift default window policy. About 400 MiB VRAM saved at the same capacity, with unchanged decode performance. The 12G 252K retrieval test passed; the 8G long-retrieval limitation is explicitly reported.

Source commit: f7090b9
Source ZIP SHA256: ed7db1cb52fea1f0fa218369928f42039737a4215be5a30206cbb6f576723b95

Bonsai2 12G Source 0.1.1

Choose a tag to compare

@5258MF 5258MF released this 04 Oct 11:10

源码版本 0.1.1,包含 Bonsai2 12G 的完整引擎工程、构建脚本、启动器和验收脚本。

  • 修复启动完成判断、缩窗后的客户端限制同步、思考预算联动和失败退出码。
  • 验收以 0/1/2 区分通过、失败和未确认,补齐实际输出封顶、工具结果回传、Messages/Responses 与看图。
  • Windows PowerShell 5.1 模拟回归 48 项通过;RTX 3060 12GB 两套小窗口实机验收通过。此次版本标记更新没有重编译引擎,也未重测满 256K/32K、速度或质量。
  • 网盘仍为此前上传的 0.1.0 包;源码 0.1.1 不代表旧网盘包已自动更新。

请选择附件 ninfer-bonsai2-12g-source-0.1.1.zip,解压后只有 bonsai2-12g/ 目录,不包含另一模型源码。GitHub 自动生成的 Source code 归档仍为整个仓库快照。

提交:6b3d1ac2013bb3e150205c4760e7128e0ea8a2c9
附件大小:10,533,566 字节;文件数:1504。
SHA256:ab802be45257c2ed73ec29d07b9ef481186049e66fe80bbb320233f2ea33c7ed

版本记录:CHANGELOG。

English: Complete Bonsai2 12G source, build and launcher scripts for 0.1.1, including startup and verification fixes. The named asset contains only bonsai2-12g/; existing 0.1.0 cloud packages remain unchanged. Engine binaries and model quantization were not changed.