CLIP embeddings search

[damian0815]

Hey folks, new user to Spacedrive here - it seems pretty great!

Would there be interest in CLIP¹ embedding support in the engine for image files (+CLAP for audio files perhaps)? I have a CLIP-driven image browser that I've been developing with a Python backend and React frontend, but the frontend is taking too much time and I'd love to be able to plug my work into something that already exists. Obviously I'd need to port it to Rust but I'd be willing to do that.

Footnotes

1. CLIP is a ML model architecture that enables natural language search for images, but it also enables other fun things too like, searching images by similarity (put all the cats next to each other), or sorting images by their distance between each other (produce a "semantic" ordering of the images so that your image ordering might go cats → mice → field → forest → mountain) ↩