Credits

Credits & Dependencies

LrGeniusAI is made possible by these amazing open-source projects and AI frameworks.

Core Backend Dependencies

• YuNet: Fast, lightweight face detector from the OpenCV Model Zoo; provides the face boxes and five landmarks. GitHub
• FaceNet (facenet-pytorch): Inception-ResNet-v1 with VGGFace2 weights; produces the face embeddings that group photos by person. GitHub
• SigLIP2 / OpenCLIP: The vision-language models behind semantic search, and the framework both SigLIP2 and BioCLIP 2 are loaded and exported with. GitHub
• ONNX Runtime: Cross-platform, high performance ML inferencing, used via the ort crate for SigLIP2, BioCLIP 2, YuNet and FaceNet. Website
• LanceDB: Embedded vector database storing embeddings and metadata. Website
• axum / tokio: Async HTTP server and runtime for geniusai-server. GitHub
• Hugging Face Tokenizers: Fast tokenizers used for the SigLIP2 text tower. GitHub

Species Identification

• BioCLIP 2 (MIT): The vision model behind on-device species identification, trained on the tree of life. Project · Model · Paper
• TreeOfLife-200M (CC0-1.0): The 200-million-image dataset BioCLIP 2 was trained on. Its precomputed text embeddings are the taxonomy the plugin classifies against — LrGeniusAI ships a pruned subset of them. Dataset
• GBIF Backbone Taxonomy: The source of the common names shown alongside each scientific name, via TreeOfLife-200M's label files. DOI 10.15468/39omei
• pybioclip: The reference implementation whose preprocessing and rank-aggregation semantics lrg-ml::bioclip reproduces in Rust. GitHub

Local Inference Engines

• llama.cpp: Runs GGUF vision models in-process on Windows (Vulkan), via the llama-cpp-2 bindings. GitHub
• llguidance: Turns JSON Schemas into decode-time constraints, so local models return valid structured output. GitHub
• MLX & mlx-swift-lm: Apple's array framework and its language-model package, powering the lrgenius-mlx sidecar on Apple silicon. GitHub
• Gemma, Qwen-VL and SmolVLM: The open-weights vision models offered in the built-in model catalogs.

AI Model Providers & Interfaces

• Google Gemini: Large language models for multimodal analysis.
• Google Vertex AI: Enterprise AI platform for training and deploying models. (removed from the plugin in August 2026; the backend client code remains but is unused.)
• OpenAI / ChatGPT: Advanced conversational AI and embeddings.
• Ollama: Run open-source large language models locally. Website
• LM Studio: Discover, download, and run local LLMs. Website

Utilities & SDKs

• JSON.lua: A complete JSON encoder/decoder in Lua by Jeffrey Friedl.
• Adobe Lightroom Classic SDK: The Lua API the plugin frontend is built on.
• Hugging Face Hub: Distribution for the downloadable local models.

---

Developed by Bastian Machek (LrGenius / Fokuspunk) and AI agents.