v1.0.0

Llama Manager is a Windows terminal user interface for managing, launching, monitoring, benchmarking, and updating llama.cpp models from a single interface.

Features

Model Management

• Automatically discovers GGUF models in the local models directory.
• Extracts and caches metadata such as architecture, parameter count, quantization, and context length.
• Supports custom tags and notes for model organization.

Memory Estimation

• Detects local hardware, including CPU, RAM, GPU, VRAM, and CUDA support.
• Estimates model and KV cache memory usage before launch.
• Provides color-coded fit indicators for selected configurations.

Launch Profiles

• Includes preset and custom launch configurations.
• Displays the exact llama.cpp command before execution.
• Starts and manages llama.cpp server instances directly from the TUI.

Downloads

• Download models from URLs or Hugging Face repositories.
• Supports selecting specific GGUF files from repositories with multiple weights.
• Download queue with pause, resume, and cancel controls.

Monitoring & Updates

• Real-time monitoring of running servers, including throughput, uptime, and resource usage.
• Built-in llama.cpp update, backup, and rollback management.

Customization

• Multiple built-in themes with customizable terminal appearance.