model-runner

Here is 1 public repository matching this topic...

Model-first local inference with permissioned hardware inspection and explained CPU/GPU configurations.

cli model-deployment model-runner llm local-inference llama-cpp local-llm local-ai gguf cpu-gpu-offload

To associate your repository with the model-runner topic, visit your repo's landing page and select "manage topics."