Skip to content

Ponko v2.1.0-beta.4

Pre-release
Pre-release

Choose a tag to compare

@visitor257 visitor257 released this 01 Nov 10:17

Ponko is an offline-capable AI app for Android: chat (image, file and document input) +
drawing + tagging, each of which can be served over its own OpenAI-compatible API.
All inference runs on-device: apart from the optional in-app LoRA download, no feature
needs the network. No telemetry; your data stays on your phone.
See the README.

This is a pre-release. It installs alongside the stable app (package
com.litertchat.app.beta).

What changed since 2.1.0-beta.3

PixArt works now, and its preview does too.

beta.3 fixed why PixArt would not load - a prefix applied twice, 603 of 603 tensors
unreachable. It loads and renders correctly now: 256×256, 20 steps, CFG 4.5,
Euler/Discrete, 591 seconds, lowest free memory 3238 MB, no tensor errors at all.

That run also exposed a smaller gap. The preview pane stayed blank for the whole render,
and the engine was saying so:

W: No latent to RGB projection known for this model

preview_image() chooses a latent-to-RGB projection by channel count. The 4-channel branch
knew SDXL and SD1/SD2 and sent everything else to the warning-and-return. PixArt is
4-channel, so it never got one.

The fix is to use one of the two existing tables - but it has to be the right one. PixArt
Alpha-512 ships an SD1.5 VAE (scale 0.18215) and Sigma ships an SDXL VAE (0.13025); the
latent spaces differ, so the coefficients are not interchangeable, and using the wrong one
shows up as wrong colours - which reads as a broken model rather than a wrong preview.

Rather than branch on version names, this reads the scale factor off first_stage_model -
the very value configure_pixart_vae() already decided from whether csize_embedder is
present. One source of truth, so the preview cannot disagree with how the image was
actually encoded.

Still true from earlier betas

  • Reference images (beta.1/beta.2): up to two, shown only for models that accept them.
    Opens Krea2 style reference, FLUX Kontext, Qwen-Image-Edit, Fibo 2, Longcat and MageFlow.
    Verified on a real device: the Krea2 LoRA matches 512/512 and the output style follows the
    reference
  • PixArt and MOSS name fix (beta.3): converters receive bare names and must return bare
    names. The wrapper appended a prefix the caller had already stripped
  • Load diagnostics (beta.3): the load path never drained sd.cpp's log buffer, so a
    failure produced one line and no evidence. During nativeCreate every INFO is captured,
    the cap rises to 200 lines, and the app drains it on both outcomes
  • The 2.0.4 features: per-conversation system prompt, its systemInstruction fix, and
    the drawing diagnostics that surface the engine's LoRA decisions

Please read before reporting

MOSS-Image still has never been loaded. It got the same prefix fix as PixArt, verified
the same way, but nobody has tried it - and it needs roughly 12 GB of weights, beyond most
phones.

中文说明

Ponko 是一个可离线运行的 Android AI 应用:对话(支持图片、文件、文档输入)+ 绘图 + 打标,
三者都能各自开一个 OpenAI 兼容 API。所有推理都在设备本地完成——除了可选的 App 内 LoRA
下载,任何功能都不需要联网。无遥测,数据留在你手机上。

这是预发布版。 它与正式版并存(包名 com.litertchat.app.beta)。

相对 2.1.0-beta.3 改了什么

PixArt 能用了,预览也正常了。

beta.3 修的是 PixArt 为什么加载不了——前缀被加了两次,603 个张量全部对不上。现在它加载
和出图都正确:256×256、20 步、CFG 4.5、Euler/Discrete,591 秒,最低可用内存
3238 MB,没有任何张量报错。

那次运行还暴露出一个小缺口:整个渲染过程预览框都是空的,而引擎其实一直在说原因:

W: No latent to RGB projection known for this model

preview_image() 按 latent 通道数挑投影表。4 通道那条分支只认 SDXL 和 SD1/SD2,
其余全部落到「警告并返回」。PixArt 就是 4 通道,所以一张都没拿到。

修法是从两张现成的表里选一张——但必须选对。PixArt Alpha-512 用的是 SD1.5 VAE
(scale 0.18215),Sigma 用的是 SDXL VAE(0.13025);两者 latent 空间不同,系数不能混用,
用错了表现为颜色不对——那看起来像是模型坏了,而不是预览错了。

所以这里不按版本名分支,而是直接读 first_stage_model 上的缩放因子——那正是
configure_pixart_vae() 按有没有 csize_embedder 定下来的值。单一事实来源,
预览不可能和实际编码方式对不上。

更早的 beta 里仍然有效的内容

  • 参考图(beta.1/beta.2):最多两张,只在当前模型接受参考图时显示。由此解锁 Krea2 的
    style reference、FLUX Kontext、Qwen-Image-Edit、Fibo 2、Longcat、MageFlow。
    已在真机验证:Krea2 的 LoRA 512/512 全部匹配,出图风格确实跟随参考图
  • PixArt 与 MOSS 的命名修复(beta.3):转换函数拿到的是裸名,也必须返回裸名。原包装补了
    一个调用方已经剥掉的前缀
  • 加载诊断(beta.3):加载路径从来不取 sd.cpp 的日志缓冲,所以失败只留下一行字、
    没有任何证据。现在 nativeCreate 期间全量捕获 INFO,上限提到 200 行,
    成败两种情况 App 都会取走
  • 2.0.4 的功能:按对话保存的系统提示词、它的 systemInstruction 修复、
    以及把引擎的 LoRA 判断输出到日志的绘图诊断

报告问题前请看

MOSS-Image 仍然从来没有被加载过。 它和 PixArt 拿到了同一处前缀修复,同样的验证方式,
但没人试过——而且它需要约 12 GB 权重,超出多数手机的范围。