Repository navigation
Benchmark v3 — configurations 17–24
Pre-release
Eight ARM64 APKs for benchmark v3, configurations 17–24. Install the APK for your assigned configuration and tap Start / resume. Model and retrieval assets download separately and are verified by SHA-256.
| Configurations | Model | RAG |
|---|---|---|
| 17 / 18 | Energy-Mobile mixed 4/8-bit | MobileRAG+ / F6 |
| 19 / 20 | Gemma 4 E2B-IT mixed 2/4/8-bit | MobileRAG+ / F6 |
| 21 / 22 | LFM3 fine-tuned Q4_K_M | MobileRAG+ / F6 |
| 23 / 24 | LFM3 RLVR v3s400 Q4_0 | MobileRAG+ / F6 |
Energy and Gemma request LiteRT-LM GPU; LFM requests Vulkan GPU. Embeddings run on CPU. All configurations include live tool calling and record retrieval candidates, final context, and per-question timings for retrieval and QA evaluation. F6 retains its NR/manual corpus without internal CEMIG documents.
All eight actual-model CPU emulator smoke tests passed with their assigned retrieval pipelines. Physical-phone GPU stability and complete 120-question benchmark runs are pending. This release therefore remains a prerelease.
Protocol and configuration details · Validation evidence
APK version: 3.0 (code 12). Android source: 25d29aecd05df1664d39b24a262aafb53d43111a; evaluation/documentation source: 86976e8440179587d4411ed868403b9a16606beb. Download SHA256SUMS and manifest.json for APK checksums and model pins. Installing another configuration updates the same app; finish or stop the current run before switching.