Deploy LangServe on Koyeb
Learn more about Koyeb
·
Explore the documentation
·
Discover our tutorials
Koyeb is a developer-friendly serverless platform to deploy apps globally. No-ops, servers, or infrastructure management.
This repository contains is designed to show how LangServe applications can be deployed to Koyeb. The image that this repository builds serves a LangServe application that uses LangChain to query the OpenAI API.
You can follow the associated tutorial to learn more about how the example was constructed.
Follow the steps below to deploy the LangServe application to your Koyeb account.
To use this repository, you need:
- A Koyeb account to build the Docker image and run the Dockerized application. If you don't already have an account, you can sign-up for free.
- An OpenAI API key so that our application can send queries to OpenAI.
The fastest way to deploy the LangServe application is to click the Deploy to Koyeb button below.
Clicking on this button brings you to the Koyeb App creation page with most of the settings pre-configured to launch this application. You will need to replace the value for the following variable:
OPENAI_API_KEY: Set to your OpenAI API key.
To modify this application example, you will need to fork this repository. Checkout the fork and deploy instructions.
If you want to customize and enhance this application, you need to fork this repository.
If you used the Deploy to Koyeb button, you can simply link your service to your forked repository to be able to push changes. Alternatively, you can manually create the application as described below.
On the Koyeb Control Panel, on the Overview tab, click the Create Web Service button to begin.
- Select GitHub as the deployment method.
- Choose the GitHub repository and branch containing your application code.
- In the Builder section, celect Dockerfile.
- Expand the Environment variables section and click Add variable to configure a new environment variable. Create a variable called
OPENAI_API_KEY. Select the Secret type and choose Create secret in the value. In the form that appears, create a new secret containing your OpenAI API key. - Choose a name for your App and Service, i.e.
example-langserve, and click Deploy.
A container image for the LangServe application will be built and a container will be deployed to Koyeb. You can follow the build process as the repository is cloned, built, and deployed. Once the deployment is complete, it will be accessible using the Koyeb subdomain for your service. Visit the URL with /openai/playground appended to view the prompt interface.
If you have any questions, ideas or suggestions regarding this application sample, feel free to open an issue or fork this repository and open a pull request.