Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

feat: cortex run model(:gguf) part 2 #1362

@gabrielle-ong

Description

@gabrielle-ong

Problem

  • Followup to feat: cortex run model(:gguf) #1076
  • currently, cortex run/chat model_id:option requires stating option eg :gguf in every command
  • [to be discussed] For better UX, users can run cortex run model_id without the additional option

Solution brainstorm (WIP)

  1. We will likely need a main branch on the Hugging Face Cortex Model repo to support this use case
  2. In the long term, this will likely be replaced by something that automatically detects users' hardware and picks the correct engine.

Success Criteria

  • cortex run model_id

Tasklist

  • [ ]

Metadata

Metadata

Labels

wontfixThis will not be worked on

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions