Skip to content

Ponko v2.1.0-beta.5

Pre-release
Pre-release

Choose a tag to compare

@visitor257 visitor257 released this 01 Nov 11:00

Ponko is an offline-capable AI app for Android: chat (image, file and document input) +
drawing + tagging, each of which can be served over its own OpenAI-compatible API.
All inference runs on-device: apart from the optional in-app LoRA download, no feature
needs the network. No telemetry; your data stays on your phone.
See the README.

This is a pre-release. It installs alongside the stable app (package
com.litertchat.app.beta).

What changed since 2.1.0-beta.4

MOSS-Image can be given its tokenizer, which it cannot load without.

beta.3 fixed the tensor-name prefix that stopped PixArt and MOSS from loading at all. For
MOSS that was necessary but not sufficient. Its conditioner is an LLM encoder, and unlike
the other LLM families - which fall back to the vocab tables compiled into the binary -
MOSS has no fallback:

if (version == VERSION_MOSS_IMAGE) {
    throw std::runtime_error("MOSS-Image requires the official Qwen3.5 tokenizer.json");
}

It needs tokenizer.json supplied from outside. The app had no way to supply one: the
field was never wired, no slot existed, and the slot table ended at TAESD.

  • New Tokenizer JSON slot. Appended at the end of the slot table rather than placed
    next to llm, because slot positions are persisted by index in existing model sets -
    inserting in the middle would shift everything after it and quietly mis-assign files
  • Import accepts .json for that slot only. The import path only took
    gguf/safetensors/ckpt/pt, so a .json was rejected before it could reach any slot.
    Picking a .json for a weights slot still fails, and with a message that says which
    mistake you made
  • MOSS gets its own slot template instead of sharing the LLM-encoder list, since its
    tokenizer is required rather than optional

Same slot also unblocks Lens and PiD, which hit the identical requirement in sd.cpp.

Still true from earlier betas

  • PixArt works (beta.3 + beta.4): 256×256, 20 steps, CFG 4.5, Euler/Discrete, 591 s on
    a 15.6 GB device, preview included. Use an SDXL VAE - Sigma keeps the 0.13025 scale
    factor and an SD1.5 VAE gives wrong colours
  • Reference images (beta.1/beta.2): up to two, only for models that accept them. Opens
    Krea2 style reference, FLUX Kontext, Qwen-Image-Edit, Fibo 2, Longcat and MageFlow
  • Load diagnostics (beta.3): the load path now drains sd.cpp's log buffer on both
    success and failure, so a failed load explains itself
  • The 2.0.4 features: per-conversation system prompt, its systemInstruction fix, and
    the drawing diagnostics that surface the engine's LoRA decisions

Please read before reporting

MOSS has still never been loaded. This release only makes it possible to try. Two things
to know before you do:

  • You need the Qwen3.5 tokenizer.json — the one from the Qwen3.5 release, not Qwen3-VL
  • The smallest complete set is about 12 GB (moss_image_sft_int8_convrot 5.4 GB +
    qwen3.5_9b_w4a8_gptq 7.0 GB + flux2-vae_small 0.25 GB). Whether that fits depends on
    your device; on a 15.6 GB phone with 6 GB free it may run out of memory during text
    encoding, before any sampling starts

中文说明

Ponko 是一个可离线运行的 Android AI 应用:对话(支持图片、文件、文档输入)+ 绘图 + 打标,
三者都能各自开一个 OpenAI 兼容 API。所有推理都在设备本地完成——除了可选的 App 内 LoRA
下载,任何功能都不需要联网。无遥测,数据留在你手机上。

这是预发布版。 它与正式版并存(包名 com.litertchat.app.beta)。

相对 2.1.0-beta.4 改了什么

MOSS-Image 现在可以给它 tokenizer 了——没有它,MOSS 加载不了。

beta.3 修的是让 PixArt 和 MOSS 完全加载不了的前缀问题。对 MOSS 来说那是必要条件,不是
充分条件。它的 conditioner 是 LLM 编码器,而和其他 LLM 家族不同——其他家族会回退到编进
二进制里的词表——MOSS 没有回退:

if (version == VERSION_MOSS_IMAGE) {
    throw std::runtime_error("MOSS-Image requires the official Qwen3.5 tokenizer.json");
}

它必须由外部提供 tokenizer.json。而 App 之前没有任何途径提供:字段没接、槽位不存在、
槽位表停在 TAESD。

  • 新增 Tokenizer JSON 槽位。 追加在槽位表末尾,而不是放在 llm 旁边——已有模型集按
    位置索引存槽位,插在中间会让后面全部错位,静默地把文件配给错误的槽
  • 只有这个槽位接受 .json。 导入路径原本只收 gguf/safetensors/ckpt/pt,
    .json 在到达槽位之前就被拒了。给权重槽位选 .json 仍然会失败,但会给出说明
    是哪种错误的信息
  • MOSS 单独一个槽位模板,不再和其他 LLM 编码器共用,因为它的 tokenizer 是必填而不是可选

同一个槽位也顺带解锁了 Lens 和 PiD——它们在 sd.cpp 里撞的是同一个要求。

更早的 beta 里仍然有效的内容

  • PixArt 可用(beta.3 + beta.4):256×256、20 步、CFG 4.5、Euler/Discrete,
    15.6 GB 设备上 591 秒,预览也正常。VAE 请用 SDXL 的——Sigma 保持 0.13025 缩放因子,
    用 SD1.5 的会偏色
  • 参考图(beta.1/beta.2):最多两张,只在当前模型接受参考图时显示。由此解锁 Krea2 的
    style reference、FLUX Kontext、Qwen-Image-Edit、Fibo 2、Longcat、MageFlow
  • 加载诊断(beta.3):加载路径现在成败两种情况都会取走 sd.cpp 的日志缓冲,
    失败的加载会自己解释原因
  • 2.0.4 的功能:按对话保存的系统提示词、它的 systemInstruction 修复、
    以及把引擎的 LoRA 判断输出到日志的绘图诊断

报告问题前请看

MOSS 仍然从来没有被加载过。 这一版只是让它「有可能试」。动手前要知道两件事:

  • 需要 Qwen3.5 的 tokenizer.json——是 Qwen3.5 那版,不是 Qwen3-VL 的
  • 最小的完整组合约 12 GB(moss_image_sft_int8_convrot 5.4 GB +
    qwen3.5_9b_w4a8_gptq 7.0 GB + flux2-vae_small 0.25 GB)。能不能放下取决于设备;
    在 15.6 GB、可用 6 GB 的手机上,可能在文本编码阶段就内存不足,采样还没开始