llama-cpp-0.9.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.8.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.7.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.6.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.5.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.4.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.3.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.2.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.13.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.

llama-cpp-0.12.0

llama.cpp inference server with multi-node CPU tensor parallelism via the RPC backend. Designed for x86_64 Linux nodes (e.g. HPE DL380 Gen9) with no discrete GPU. All llama.cpp nodes are selected by the label llama.cpp=enabled.