Skip to content

Image models — DreamShaper, SANA-Sprint, FLUX.2 klein (v1)

Choose a tag to compare

@yu314-coder yu314-coder released this 11 Oct 00:15

Image models for WhisperKit (v1)

Format conversions for the app's Image tab, nothing retrained. Built by the
scripts in ports/imagegen/; verification in ports/README.md.

Files Contents Licence
sd_text_encoder.mlmodelc.aar, sd_unet.mlmodelc.aar, sd_vae_decoder.mlmodelc.aar, clip_vocab.json, clip_merges.txt DreamShaper 8 with ByteDance's Hyper-SD 4-step LoRA fused, Core ML for the Neural Engine (text encoder and UNet 8-bit palettized, VAE float16) and CLIP's tokenizer (convert_sd.py) CreativeML OpenRAIL-M (DreamShaper 8, Stable Diffusion 1.5); CreativeML OpenRAIL++-M (Hyper-SD)
sana_gemma_q8.part{1,2}.safetensors, gemma_bpe.bin Gemma 2 2B, SANA's prompt encoder, 8-bit for MLX, and its tokenizer as integer tables (export_sana_mlx.py) Gemma Terms of Use and Prohibited Use Policy
sana_transformer.mlmodelc.aar, sana_extras.safetensors, sana_decoder_head.safetensors, sana_decoder_tail.mlmodelc.aar SANA-Sprint 0.6B 1024 px: transformer (Core ML, 8-bit palettized), caption projection and fixed-schedule modulation, DC-AE decoder split between MLX and Core ML (convert_sana.py, export_sana_mlx.py) Apache 2.0
flux_text_q8.part{1,2}.safetensors, flux_vocab.json, flux_merges.txt Qwen3-4B, FLUX's prompt encoder — its first 27 of 36 layers — 8-bit for MLX, and its tokenizer (export_flux_mlx.py) Apache 2.0
flux_transformer_q8.part{1,2,3}.safetensors, flux_vae.safetensors FLUX.2 [klein] 4B transformer, 8-bit (bfloat16 scales), and the VAE decoder, float16 (export_flux_mlx.py) Apache 2.0
safety_checker.mlmodelc.aar Falconsai's nsfw_image_detection ViT, Core ML 8-bit palettized: the check every picture passes before it is shown (convert_safety.py) Apache 2.0

Against each upstream diffusers pipeline with the same noise, the app's
Swift drew the same pictures: SANA-Sprint 32.7 / 28.1 dB and FLUX.2 klein
30.8 / 20.5 dB PSNR on the two reference prompts.