Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

feat: cortex-cpp node binding #861

@louis-jan

Description

@louis-jan

Problem

Currently, downloading cortex-cpp along with its engines can be challenging because it requires additional dependencies such as the Cuda Toolkit and MSVC. If we were to pull any other engine, it would also need to pull llama.cpp, since it is coupled with the cortex-cpp package.

It would be more practical to build a Node.js addon module that includes cortex-cpp, allowing it to be shipped alongside the cortex npm module. Additionally, pulling any engine would not require pulling irrelevant engines or dependencies

Success Criteria
A clear and concise description of what you want to happen.

Additional context
Add any other context or screenshots about the feature request here.

Metadata

Metadata

Assignees

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions