Headless Backend Extensions

[louis-jan]

Description

We will introduce Extensions as part of the Cortex Backend, allowing us to migrate our current remote inference engine extensions into Cortex.

Some questions about how it should work alongside Cortex-JS:

1. Where are these extensions located? Should the repo be separated or within the cortex-js folder?
2. How they can be activated or deactivated?
3. Would it be scoped only by the Inference Engine?
4. How is it designed within a NestJS backend?

graph RL
Cortex[?cortex-cpp Engine Extension] -->|inject| Backend
OpenAI[?OpenAI Engine Extension] --> |inject| Backend
Cohere[?OpenAI Engine Extension] --> |inject| Backend
Groq[?Groq Engine Extension] --> |inject| Backend
... --> |inject| Backend

Loading

Subtask

• Refactor Inference Engine extensions to Backend #2783