Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Engine - New Cortex extensions supported with 3 new engines #3376

Open
Tracked by #3365
Van-QA opened this issue Aug 15, 2024 · 0 comments
Open
Tracked by #3365

feat: Engine - New Cortex extensions supported with 3 new engines #3376

Van-QA opened this issue Aug 15, 2024 · 0 comments
Assignees
Milestone

Comments

@Van-QA
Copy link
Contributor

Van-QA commented Aug 15, 2024

  • Cortex as extension -> 3 engine along side with Nitro => allow Jan calling C‌ortex API (only chat completion)
    • Llamacpp: bundle with jan app, download by default
    • Onnx and tensorRT => downloading together with specific model download
  • Nitro.llamacpp version: keep locked version, remain unchanged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: In Review
Development

No branches or pull requests

2 participants