epic: Cortex.cpp CLI MVP v0.1

[vansangpfiev]

This ticket only includes command list, the actual callback for each command will be in sub-tickets.

Architecture

• https://github.com/CLIUtils/CLI11 can be a good library: header only, no dependencies, c++11.

Installation, Updating & Uninstallation

• epic: Cortex.cpp Installer MVP (Local & Network Installer) #1030
• uninstall
• epic: cortex update command #1087

Process

• Feat background process server #1043

Engine Management

• janhq/cortex#1072
• janhq/cortex#1074
• janhq/cortex#1073

Hardware Management

• epic: OS and hardware detection #1068

Model Management

• janhq/cortex#1075
• janhq/cortex#1064
• janhq/cortex#1060
• Download engines #1078

Model Running

• janhq/cortex#1076
• feat: cortex models stop <model_id> #1204

Basic Use

• Chat
• embeddings

System

• janhq/cortex#1066
• ps
• feat: cortex stop #1205

Logs

Logs turned out to be more work than we thought, due to Windows having file perm issues and requiring us to implement Unix Daemon Sockets

• improve: redirect log to right position #1054
• bug: Multiprocess cannot write log to the same file #1056

Packaging

• Docker template

List of commands:

Unknown?

• feat: add back triton features  #29
• docs: Add developer + installation documents #31
• feat: batch inference for nitro #41
• feat: minimal deployment docker image #32
• API with llama.cpp for embedding #37

[freelerobot]

@vansangpfiev, this is really helpful.
Lets track in specs instead: #1109
I've migrated your list over 🙏

[dan-menlo]

@vansangpfiev I spoke to Nicole, I think this is better positioned as an epic that covers the Cortex CLI MVP scope.
We will keep this open for now (it will move to Sprint 20)