Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: cortex extensions #541

Merged
merged 1 commit into from
May 7, 2024
Merged

Conversation

louis-jan
Copy link
Contributor

@louis-jan louis-jan commented May 6, 2024

Description

We will introduce Extensions as part of the Cortex Backend, allowing us to migrate our current remote inference engine extensions into Cortex.

Some questions about how it should work alongside Cortex-JS:

  1. Where are these extensions located? Should the repo be separated or within the cortex-js folder?
  2. How they can be activated or deactivated?
  3. Would it be scoped only by the Inference Engine?
  4. How is it designed within a NestJS backend?
graph RL
Cortex[?cortex-cpp Engine Extension] -->|inject| Backend
OpenAI[?Mistral Engine Extension] --> |inject| Backend
Cohere[?OpenAI Engine Extension] --> |inject| Backend
Groq[?Groq Engine Extension] --> |inject| Backend
... --> |inject| Backend
Loading

Subtask

@louis-jan louis-jan marked this pull request as ready for review May 7, 2024 05:54
@louis-jan louis-jan merged commit 0178bde into feat/add-cortex-js May 7, 2024
louis-jan added a commit that referenced this pull request May 7, 2024
@louis-jan louis-jan deleted the feat/cortex-extensions branch May 24, 2024 03:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant