Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TGIS standalone SR and ISVC #134

Closed
3 tasks done
heyselbi opened this issue Nov 7, 2023 · 2 comments · Fixed by #132
Closed
3 tasks done

TGIS standalone SR and ISVC #134

heyselbi opened this issue Nov 7, 2023 · 2 comments · Fixed by #132
Assignees
@Xaenalt @heyselbi
Labels
kind/documentation Improvements or additions to documentation kind/enhancement New feature or request

Comments

@heyselbi
Copy link
Contributor

heyselbi commented Nov 7, 2023 •
edited

After Caikit-TGIS image splitting, the goal is:

  • to create the TGIS standalone ServingRuntime
  • and InferenceService
  • basic instructions on deploying and doing a sample inference call
@heyselbi heyselbi linked a pull request Nov 7, 2023 that will close this issue
Add TGIS Standalone SR and ISVC #132
Merged
3 tasks
@heyselbi heyselbi transferred this issue from opendatahub-io/text-generation-inference Nov 7, 2023
@heyselbi heyselbi self-assigned this Nov 7, 2023
@heyselbi heyselbi added kind/documentation Improvements or additions to documentation kind/enhancement New feature or request and removed rhods-2.5 labels Nov 7, 2023
@Jooho
Copy link
Contributor

Jooho commented Nov 9, 2023

REST API is disabled at the moment by upstream

@heyselbi heyselbi mentioned this issue Nov 17, 2023
Closed
@heyselbi
Copy link
Contributor Author

heyselbi commented Nov 17, 2023 •
edited

Image location: quay.io/opendatahub/text-generation-inference:stable

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Xaenalt Xaenalt

@heyselbi heyselbi

Labels
kind/documentation Improvements or additions to documentation kind/enhancement New feature or request
Projects
Internal tracking
Status: Done
ODH Model Serving Planning
Status: Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add TGIS Standalone SR and ISVC heyselbi/caikit-tgis-serving
3 participants
@Jooho @Xaenalt @heyselbi