mistral.rs Rust API: mistralrs Mistral.rs provides a convenient Rust multithreaded/async API. To install, add mistralrs = { git = "https://github.com/EricLBuehler/mistral.rs.git" } to the Cargo.toml file. Examples can be found here.