Deploy a LlamaIndex RAG application on Koyeb
Learn more about Koyeb
·
Explore the documentation
·
Discover our tutorials
Koyeb is a developer-friendly serverless platform to deploy apps globally. No-ops, servers, or infrastructure management required.
This repository contains a LLamaIndex application built using Retrieval Augmented Generation (RAG) to query about an uploaded document. You can deploy it on the Koyeb serverless platform for testing.
This example application is designed to show how LlamaIndex applications can be deployed on Koyeb.
Follow the steps below to deploy and run the LlamaIndex RAG application on your Koyeb account.
You need:
- a Koyeb account to successfully deploy and run this application. If you don't already have an account, you can sign-up for free here.
- a Together AI API key so our application can leverage the platform's AI models.
The fastest way to deploy the LlamaIndex RAG application is to click the Deploy to Koyeb button below.
Clicking on this button brings you to the Koyeb App creation page with everything pre-set to launch this application. Modify the value of the API_KEY environment value with your own key and launch the application.
To modify this application example, you will need to fork this repository. Checkout the fork and deploy instructions.
If you want to customize and enhance this application, you need to fork this repository.
If you used the Deploy to Koyeb button, you can simply link your service to your forked repository to be able to push changes. Alternatively, you can manually create the application as described below.
On the Koyeb Control Panel, on the Overview tab, click the Create Web Service button to begin.
- Select GitHub as the deployment method.
- In the repositories list, select the repository you just forked.
- Expand the Environment variables section and click Add variable. Add a variable named
API_KEYset to your Together AI API key. - Choose a name for your App and Service, i.e.
llamaindex-rag, and click Deploy.
You land on the deployment page where you can follow the build of your application. Once the build is completed, your application is being deployed and you will be able to access it via <YOUR_APP_NAME>-<YOUR_ORG_NAME>.koyeb.app.
If you have any questions, ideas or suggestions regarding this application sample, feel free to open an issue or fork this repository and open a pull request.