Skip to content
This repository was archived by the owner on Jul 4, 2025. It is now read-only.

Conversation

@hiento09
Copy link
Contributor

@hiento09 hiento09 commented Oct 15, 2024

This PR adds the necessary scripts and Dockerfile to set up and run Cortex using Docker. The following files are included:

1. entrypoint.sh:

  • Installs the cortex.llamacpp engine.
  • Starts the Cortex server.
  • Keeps the container running by tailing the log files.

2. Dockerfile:

  • Uses Ubuntu 22.04 as the base image.
  • Installs necessary dependencies.
  • Downloads and installs the latest versions of cortex.llamacpp and cortex.cpp.
  • Copies the entrypoint script and sets it as the entrypoint for the container.
  • Exposes port 39281 and sets up a health check.

3. download-cortex.llamacpp.sh:

  • Fetches the latest version of cortex.llamacpp if not specified.
  • Downloads various cortex.llamacpp engine versions and stores them in /opt/cortex.llamacpp.

4. download-cortex.cpp.sh:

  • Fetches the latest version of cortex.cpp if not specified.
  • Downloads and installs cortex.cpp to /usr/local/bin.

These additions will facilitate the setup and deployment of Cortex in a Docker container, making it easier to manage and run the Cortex server.

Related issue #365

@hiento09 hiento09 marked this pull request as ready for review October 15, 2024 02:26
@hiento09 hiento09 self-assigned this Oct 15, 2024
@hiento09 hiento09 requested a review from freelerobot October 15, 2024 06:40
@hiento09 hiento09 force-pushed the feat/docker branch 2 times, most recently from 915710c to febd5ab Compare October 21, 2024 02:06
@hiento09
Copy link
Contributor Author

image

@hiento09 hiento09 merged commit 22e344b into dev Oct 24, 2024
@hiento09 hiento09 deleted the feat/docker branch October 24, 2024 07:14
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants