Mobile benchmark 2.1 — five RTL batches and HF checkpoints

Five Android APK presets split the 120-question generation benchmark across RTL sessions. Each APK selects its batch, keeps the screen on while foreground, and can upload recoverable checkpoints to a public or private Hugging Face dataset repository.

Batch	Configurations in order	Maximum answers
1 · gpu-known	Energy mixed48 LiteRT GPU; LFM3 Q4_K_M Vulkan GPU	240
2 · gpu-new	LFM3 mixed4 LiteRT GPU; original Gemma mobile LiteRT GPU	240
3 · gemma	Original Gemma Q8 Vulkan GPU if RAM permits; Gemma mobile LiteRT CPU	240
4 · lfm-cpu	LFM3 Q4_K_M CPU	120
5 · energy-cpu	Energy int8 CPU; Energy mixed48 CPU	240

Start with batch 1 on a single phone. Colleagues can run separate batches concurrently. Every configuration uses the same 120 prompts, 4096-token context, and 512-token output cap.

All APKs share the application ID and signing certificate. Installing the next batch updates the app and preserves models, reports, and HF settings on that phone. For another RTL device, import the previous report ZIP and download the needed models again.

Create one HF dataset repository per reservation and connect it in Hugging Face upload settings using your own repository-scoped write token. Uploads occur about every minute during a run and after each configuration. Network failures retry; local checkpoints remain available. The source includes session creation and public progress-monitoring scripts. No access token is included in an APK.

Keep the app foreground and confirm its last-sync state before leaving. A batch is not guaranteed to finish within RTL's two-hour limit; resume unfinished answers in another session. Phone GPU timing/quality still needs physical validation.

Validation: all five release builds and signatures passed; emulator suite OK (24 tests), targeted cloud/batch regressions OK (4 tests), separate real-HF upload OK (1 test). The full queue test produced 1,080 synthetic answers. Public report download/checksum verification worked without authentication.

Setup and protocol · Validation details · Register a public session

Each APK is approximately 58 MB, requires Android 12 or later, and targets ARM64. Models download separately. SHA256SUMS lists the exact asset checksums.