Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

bug: Model failed to load with status code: 500, could not load engine llamacpp #1422

@dan-menlo

Description

@dan-menlo

Goal

  • A lot of useful error messages are currently not being bubbled up to CLI
  • We should bubble up as many error messages, to allow users to file more informative bugs or know what is going on

Current State

Running llama3.1 failed with model status code 500:

Image

The real error message is in the logs:

Image

Metadata

Metadata

Assignees

Type

No type

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions