Repository navigation
Ponko v2.1.0-beta.5
Pre-releasePonko is an offline-capable AI app for Android: chat (image, file and document input) +
drawing + tagging, each of which can be served over its own OpenAI-compatible API.
All inference runs on-device: apart from the optional in-app LoRA download, no feature
needs the network. No telemetry; your data stays on your phone.
See the README.
This is a pre-release. It installs alongside the stable app (package
com.litertchat.app.beta).
What changed since 2.1.0-beta.4
MOSS-Image can be given its tokenizer, which it cannot load without.
beta.3 fixed the tensor-name prefix that stopped PixArt and MOSS from loading at all. For
MOSS that was necessary but not sufficient. Its conditioner is an LLM encoder, and unlike
the other LLM families - which fall back to the vocab tables compiled into the binary -
MOSS has no fallback:
if (version == VERSION_MOSS_IMAGE) {
throw std::runtime_error("MOSS-Image requires the official Qwen3.5 tokenizer.json");
}It needs tokenizer.json supplied from outside. The app had no way to supply one: the
field was never wired, no slot existed, and the slot table ended at TAESD.
- New
Tokenizer JSONslot. Appended at the end of the slot table rather than placed
next tollm, because slot positions are persisted by index in existing model sets -
inserting in the middle would shift everything after it and quietly mis-assign files - Import accepts
.jsonfor that slot only. The import path only took
gguf/safetensors/ckpt/pt, so a.jsonwas rejected before it could reach any slot.
Picking a.jsonfor a weights slot still fails, and with a message that says which
mistake you made - MOSS gets its own slot template instead of sharing the LLM-encoder list, since its
tokenizer is required rather than optional
Same slot also unblocks Lens and PiD, which hit the identical requirement in sd.cpp.
Still true from earlier betas
- PixArt works (beta.3 + beta.4): 256×256, 20 steps, CFG 4.5, Euler/Discrete, 591 s on
a 15.6 GB device, preview included. Use an SDXL VAE - Sigma keeps the 0.13025 scale
factor and an SD1.5 VAE gives wrong colours - Reference images (beta.1/beta.2): up to two, only for models that accept them. Opens
Krea2 style reference, FLUX Kontext, Qwen-Image-Edit, Fibo 2, Longcat and MageFlow - Load diagnostics (beta.3): the load path now drains sd.cpp's log buffer on both
success and failure, so a failed load explains itself - The 2.0.4 features: per-conversation system prompt, its
systemInstructionfix, and
the drawing diagnostics that surface the engine's LoRA decisions
Please read before reporting
MOSS has still never been loaded. This release only makes it possible to try. Two things
to know before you do:
- You need the Qwen3.5 tokenizer.json — the one from the Qwen3.5 release, not Qwen3-VL
- The smallest complete set is about 12 GB (
moss_image_sft_int8_convrot5.4 GB +
qwen3.5_9b_w4a8_gptq7.0 GB +flux2-vae_small0.25 GB). Whether that fits depends on
your device; on a 15.6 GB phone with 6 GB free it may run out of memory during text
encoding, before any sampling starts
中文说明
Ponko 是一个可离线运行的 Android AI 应用:对话(支持图片、文件、文档输入)+ 绘图 + 打标,
三者都能各自开一个 OpenAI 兼容 API。所有推理都在设备本地完成——除了可选的 App 内 LoRA
下载,任何功能都不需要联网。无遥测,数据留在你手机上。
这是预发布版。 它与正式版并存(包名 com.litertchat.app.beta)。
相对 2.1.0-beta.4 改了什么
MOSS-Image 现在可以给它 tokenizer 了——没有它,MOSS 加载不了。
beta.3 修的是让 PixArt 和 MOSS 完全加载不了的前缀问题。对 MOSS 来说那是必要条件,不是
充分条件。它的 conditioner 是 LLM 编码器,而和其他 LLM 家族不同——其他家族会回退到编进
二进制里的词表——MOSS 没有回退:
if (version == VERSION_MOSS_IMAGE) {
throw std::runtime_error("MOSS-Image requires the official Qwen3.5 tokenizer.json");
}它必须由外部提供 tokenizer.json。而 App 之前没有任何途径提供:字段没接、槽位不存在、
槽位表停在 TAESD。
- 新增
Tokenizer JSON槽位。 追加在槽位表末尾,而不是放在llm旁边——已有模型集按
位置索引存槽位,插在中间会让后面全部错位,静默地把文件配给错误的槽 - 只有这个槽位接受
.json。 导入路径原本只收 gguf/safetensors/ckpt/pt,
.json在到达槽位之前就被拒了。给权重槽位选.json仍然会失败,但会给出说明
是哪种错误的信息 - MOSS 单独一个槽位模板,不再和其他 LLM 编码器共用,因为它的 tokenizer 是必填而不是可选
同一个槽位也顺带解锁了 Lens 和 PiD——它们在 sd.cpp 里撞的是同一个要求。
更早的 beta 里仍然有效的内容
- PixArt 可用(beta.3 + beta.4):256×256、20 步、CFG 4.5、Euler/Discrete,
15.6 GB 设备上 591 秒,预览也正常。VAE 请用 SDXL 的——Sigma 保持 0.13025 缩放因子,
用 SD1.5 的会偏色 - 参考图(beta.1/beta.2):最多两张,只在当前模型接受参考图时显示。由此解锁 Krea2 的
style reference、FLUX Kontext、Qwen-Image-Edit、Fibo 2、Longcat、MageFlow - 加载诊断(beta.3):加载路径现在成败两种情况都会取走 sd.cpp 的日志缓冲,
失败的加载会自己解释原因 - 2.0.4 的功能:按对话保存的系统提示词、它的
systemInstruction修复、
以及把引擎的 LoRA 判断输出到日志的绘图诊断
报告问题前请看
MOSS 仍然从来没有被加载过。 这一版只是让它「有可能试」。动手前要知道两件事:
- 需要 Qwen3.5 的 tokenizer.json——是 Qwen3.5 那版,不是 Qwen3-VL 的
- 最小的完整组合约 12 GB(
moss_image_sft_int8_convrot5.4 GB +
qwen3.5_9b_w4a8_gptq7.0 GB +flux2-vae_small0.25 GB)。能不能放下取决于设备;
在 15.6 GB、可用 6 GB 的手机上,可能在文本编码阶段就内存不足,采样还没开始