Skip to content

๐Ÿค– Open-source LLMs server (OpenAI, LLaMA2, Bedrock) with support for HTTP, Server Sent Events, and Vector Search (Pinecone, Redis).

License

Notifications You must be signed in to change notification settings

Parzon/llm-server

ย 
ย 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

57 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿค– Prompt Engineers AI - LLM Server

Full LLM REST API with prompts, LLMs, Vector Databases, and Agents

Useful Links

๐Ÿ› ๏ธ Server Setup and Usage

### Setup Virtual Env
python3 -m venv .venv

### Activate Virtual Env
source .venv/bin/activate

### Install Runtime & Dev Dependencies
pip install -r requirements.txt -r requirements-dev.txt

### Install Runtime Dependencies
pip install -r requirements.txt

### Run Application on local machine
bash scripts/dev.sh

๐Ÿ› ๏ธ Client Setup and Usage

### Navigate to client folder
cd client

### Install Dependencies
npm install

### Run Development Environment
npm start

### Build Production Start App (Optional)
bash scripts/client.sh

Environment Variables

Variable Name Example Description
APP_SUPER_ADMIN_KEY this-is-a-secret-key Custom `x-api-key` header
USER_admin password Basic Authentication
OPENAI_API_KEY sk-abc123... Default LLM OpenAI key
MONGO_CONNECTION mongodb://localhost:27017 Mongo database server host
MONGO_DB_NAME promptengineers-llm-server Application database

Deploy

  1. Log in to vercel
vercel login
  1. Deploy to vercel
vercel .

๐Ÿค How to Contribute

We welcome contributions from the community, from beginners to seasoned developers. Here's how you can contribute:

  1. Fork the repository: Click on the 'Fork' button at the top right corner of the repository page on GitHub.

  2. Clone the forked repository to your local machine: git clone <forked_repo_link>.

  3. Navigate to the project folder: cd llm-server.

  4. Create a new branch for your changes: git checkout -b <branch_name>.

  5. Make your changes in the new branch.

  6. Commit your changes: git commit -am 'Add some feature'.

  7. Push to the branch: git push origin <branch_name>.

  8. Open a Pull Request: Go back to your forked repository on GitHub and click on 'Compare & pull request' to create a new pull request.

Please ensure that your code passes all the tests and if possible, add tests for new features. Always write a clear and concise commit message and pull request description.

๐Ÿ’ก Issues

Feel free to submit issues and enhancement requests. We're always looking for feedback and suggestions.

๐Ÿค“ Maintainers

  • Ryan Eggleston - ryan.adaptivebiz@gmail.com

๐Ÿ“œ License

This project is open-source, under the MIT License. Feel free to use, modify, and distribute the code as you please.

Happy Prompting! ๐ŸŽ‰๐ŸŽ‰

About

๐Ÿค– Open-source LLMs server (OpenAI, LLaMA2, Bedrock) with support for HTTP, Server Sent Events, and Vector Search (Pinecone, Redis).

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 81.6%
  • Shell 10.1%
  • HTML 8.3%