Skip to content

v2: CLIP + DSINE + Whisper + SmolVLM

Choose a tag to compare

@john-rocky john-rocky released this 05 Apr 03:12
· 292 commits to main since this release

New Models

CLIP ViT-B/32 — Zero-Shot Classification

  • clip_image_encoder.tflite (352 MB) — image encoder, CompiledModel GPU
  • text_embeddings.bin (192 KB) + labels.txt — 96 pre-computed label embeddings

DSINE — Surface Normal Estimation (CVPR 2024)

  • dsine.tflite (282 MB) — encoder + decoder initial prediction, CompiledModel GPU

Whisper-tiny — Speech Recognition

  • whisper_encoder.tflite (33 MB) — mel spectrogram encoder, CompiledModel GPU
  • whisper_decoder.onnx (199 MB) — autoregressive text decoder, ONNX Runtime CPU
  • vocab.json + mel_filters.bin + config.json — tokenizer and preprocessing

SmolVLM-256M — Vision-Language Model

  • smolvlm_vision.tflite (357 MB) — SigLIP vision encoder + connector, CompiledModel GPU
  • smolvlm_decoder.onnx (515 MB) — SmolLM2 language model, ONNX Runtime CPU
  • embed_tokens.bin (108 MB) — token embedding matrix

Setup (large models)

Models are too large for APK assets. Push via adb:

adb push <model> /data/local/tmp/
adb shell "run-as <package> cp /data/local/tmp/<model> /data/data/<package>/files/"