Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add llm sdk integration example #395

Merged
merged 1 commit into from
Sep 16, 2024

Conversation

lizzzcai
Copy link
Member

Add a section on how to integrate KServe LLM service with LLM SDKs.

fixes #385

Proposed Changes

  • add a section SDK Integration Huggingface LLM to show how to integrate KServe LLM service with popular SDK.

Signed-off-by: Lize Cai <lize.cai@sap.com>
Copy link

netlify bot commented Sep 10, 2024

Deploy Preview for elastic-nobel-0aef7a ready!

Name Link
🔨 Latest commit 2507f87
🔍 Latest deploy log https://app.netlify.com/sites/elastic-nobel-0aef7a/deploys/66e0021f4c86580008c45aaf
😎 Deploy Preview https://deploy-preview-395--elastic-nobel-0aef7a.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@lizzzcai
Copy link
Member Author

/assign @yuzisun

@yuzisun
Copy link
Member

yuzisun commented Sep 16, 2024

/lgtm
/approve

@yuzisun yuzisun merged commit 6aa3ac6 into kserve:main Sep 16, 2024
5 checks passed
@lizzzcai lizzzcai deleted the llm-add-openai-langchain-examples branch September 16, 2024 02:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Examples for LLM Use Cases with Langchain and Llamaindex
2 participants