This repository was archived by the owner on Jul 4, 2025. It is now read-only.

This repository was archived by the owner on Jul 4, 2025. It is now read-only.

feat: batch inference for nitro #41

Closed

Assignees

Labels

Milestone

opened

upstream from

ggml-org/llama.cpp#3228

Metadata

Assignees

tikikun

Labels

Type

No type

Projects

Milestone

Nitro v0.2

Relationships

None yet

Development

No branches or pull requests