Skip to content

NodeLift 0.2.1 · Native engine laboratory

Pre-release
Pre-release

Choose a tag to compare

@sev7enITA sev7enITA released this 31 Oct 21:15
· 174 commits to main since this release

NodeLift now has a native inference engine and mobile draft workers. The computer verifies proposed tokens before committing output; expired or failed remote work falls back to the host. This is an experimental prerelease, with measurements and qualification limits published alongside the code.

  • Locked llama.cpp core, greedy block verification, KV resynchronization, identity checks, pinned TLS work leases and bounded remote deadlines.
  • Android ARM64 CPU companion and iOS Metal/CPU companion source, with model integrity, battery/thermal controls and lifecycle handling.
  • Desktop control room, original NodeLift identity, restricted authenticated chat/SSE gateway and LM Studio generator adapter.
  • Actual Gemini 4 High and GLM 5.3 Max design/source reviews, adjudicated against code and primary sources.

Validation: 26 host tests, 29 real-weight native checks, four real-weight TLS loopback fault cases, live gateway tests and three adapter stream tests passed. Android and unsigned iOS device builds succeeded. GitHub CI passed on the implementation commit.

Measurements include two 60-run NodeLift control sessions, 36 upstream comparison requests, and a separate large-model host kernel baseline. In the frozen-build small-pair session, local draft block 4 reached 0.719× the host-only speed: slower. All 48 paired token-ID comparisons matched. This is not a physical-phone result or a universal equivalence guarantee.

Still open: native phone inference/speedup, sustained thermal behavior, capacity sharding, hybrid-model speculative checkpoints, HarmonyOS NEXT native worker and installed LM Studio GUI qualification. The large 27B host baseline (15.344 token/s) was upstream llama-bench, not NodeLift hybrid support.

Assets:

  • Android APK: debug-signed laboratory build, version 0.2.1/build3. Upgrade over the earlier same-key app to preserve pairing, then resume and download/activate the configured draft from the Mac.
  • iOS ZIP: unsigned app build; requires valid signing/provisioning, not directly installable.
  • Source ZIP and SHA-256 build manifest: no weights, pairing database, private prompts or signing keys.

See engine guide, full results and review adjudication.