Repository navigation
Ponko v2.1.0-beta.3
Pre-releasePonko is an offline-capable AI app for Android: chat (image, file and document input) +
drawing + tagging, each of which can be served over its own OpenAI-compatible API.
All inference runs on-device: apart from the optional in-app LoRA download, no feature
needs the network. No telemetry; your data stays on your phone.
See the README.
This is a pre-release. It installs alongside the stable app (package
com.litertchat.app.beta).
What changed since 2.1.0-beta.2
beta.2 claimed PixArt and MOSS-Image now load. Neither did. The cause was mine, in the code
I added for them, and it is fixed here.
The double prefix
Tensor names arrive at the converter already handled in both directions:
name = convert_diffusion_model_name(name.substr(prefix.size()), prefix, version);
name = prefix + name; // the caller re-adds itSo converters work on bare names and must return bare names. I added a wrapper that
appended model.diffusion_model. whenever the result had no known top-level prefix - which
is always the case for a diffusion tensor, since that prefix is exactly what the caller
just stripped. Every one of the 603 PixArt tensors came out as
model.diffusion_model.model.diffusion_model.x_embedder.proj.weight. The model found none
of them and init() returned false, so the app could only report
new_sd_ctx returned 0.
MOSS carried the same wrapper with the same bug; it simply had not been loaded yet, so
PixArt reported it first. Both are fixed by reducing the wrapper to what it should have
been - stripping an optional transformer. layer and nothing else.
Verified by replaying the actual PixArt file through the actual call shape: 603 tensors in,
603 double-prefixed before, zero after, and every layer PixArt asks for resolves.
The silence that made it hard to see
sd.cpp knew what went wrong and logged it. The load path never drained that buffer - only
the render path called takeWarnings() - so a load failure produced exactly one line and
no evidence.
During nativeCreate the log filter now captures INFO as well as WARN/ERROR and the buffer
cap rises from 40 lines to 200. The app drains it on both outcomes: on failure everything
goes into the DRAW log, on success the INFO lines are dropped so render logs stay readable.
A side effect worth having - the load now records sd.cpp's Version: line, so whether
detection matched is visible rather than inferred.
Still true from beta.1 and beta.2
- The 2.0.4 features: per-conversation system prompt, its
systemInstructionfix, and the
drawing diagnostics that surface the engine's LoRA decisions - Reference images: up to two, shown only for models that accept them. This opens Krea2
style reference, FLUX Kontext, Qwen-Image-Edit, Fibo 2, Longcat and MageFlow - Krea2 style reference verified on a real device: the LoRA matches 512/512, and with a
reference image the output style follows it
Please read before reporting
PixArt has still never loaded successfully. This release is the fix for why, verified
by replay against the real weight file, but not by generating an image. If it fails again,
the DRAW log now carries sd.cpp's own reason - please include it.
MOSS-Image has never been loaded at all. Same fix, same caveat, and it needs roughly
12 GB of weights which is beyond most phones.
中文说明
Ponko 是一个可离线运行的 Android AI 应用:对话(支持图片、文件、文档输入)+ 绘图 + 打标,
三者都能各自开一个 OpenAI 兼容 API。所有推理都在设备本地完成——除了可选的 App 内 LoRA
下载,任何功能都不需要联网。无遥测,数据留在你手机上。
这是预发布版。 它与正式版并存(包名 com.litertchat.app.beta)。
相对 2.1.0-beta.2 改了什么
beta.2 说 PixArt 和 MOSS-Image 现在能加载了。两个都不能。原因出在我为它们加的那段代码里,
这一版修掉了。
前缀被加了两次
张量名到转换函数手里时,前缀已经由调用方处理过两个方向:
name = convert_diffusion_model_name(name.substr(prefix.size()), prefix, version);
name = prefix + name; // 调用方自己加回来所以转换函数拿到的是裸名,也必须返回裸名。我加的那层包装看到结果没有已知顶层前缀,就自己补了
一个 model.diffusion_model.——而扩散模型张量永远符合这个条件,因为那个前缀正是调用方刚
剥掉的东西。PixArt 的 603 个张量全变成了
model.diffusion_model.model.diffusion_model.x_embedder.proj.weight,模型一个都找不到,
init() 返回 false,App 只能报一句 new_sd_ctx returned 0。
MOSS 带着一模一样的包装和一模一样的 bug,只是还没被加载过,所以先由 PixArt 报出来。
两个都修了——把包装缩回它本该做的事:只剥一层可选的 transformer.,别的什么都不做。
验证方式是把真实的 PixArt 文件按真实的调用形态重放一遍:603 个张量,修前 603 个双前缀,
修后 0 个,PixArt 需要的每一层都能对上。
让它难以发现的沉默
sd.cpp 知道出了什么问题,也打了日志。但加载路径从来不把那个缓冲取走——只有出图路径会调用
takeWarnings()——所以一次加载失败只留下一行字,没有任何证据。
现在 nativeCreate 期间过滤器除了 WARN/ERROR 还收 INFO,缓冲上限从 40 行提到 200 行。
App 在两种结果下都会取走:失败时全部写进 DRAW 日志,成功时丢掉 INFO 行,让出图日志保持干净。
顺带一个好处:加载时会记下 sd.cpp 的 Version: 一行,版本探测有没有命中从此是看到的,不是猜的。
beta.1 / beta.2 里仍然有效的内容
- 2.0.4 的功能:按对话保存的系统提示词、它的
systemInstruction修复、以及把引擎的
LoRA 判断输出到日志的绘图诊断 - 参考图:最多两张,只在当前模型接受参考图时显示。由此解锁 Krea2 的 style reference、
FLUX Kontext、Qwen-Image-Edit、Fibo 2、Longcat、MageFlow - Krea2 style reference 已在真机验证:LoRA 512/512 全部匹配,加参考图后出图风格确实跟随
报告问题前请看
PixArt 至今没有成功加载过一次。 这一版是对「为什么不行」的修复,靠重放真实权重文件验证,
没有靠出图验证。如果还是失败,DRAW 日志里现在有 sd.cpp 自己给出的原因,请一并附上。
MOSS-Image 从来没有被加载过。 同一处修复,同样的保留意见,而且它需要约 12 GB 权重,
超出多数手机的范围。