Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

REST/gRPC gateway interface for inference service #21

Closed
spillai opened this issue Apr 18, 2023 · 1 comment
Closed

REST/gRPC gateway interface for inference service #21

spillai opened this issue Apr 18, 2023 · 1 comment
Assignees
@spillai
Labels
feature New feature or request
Milestone
NOS v0.0.11

Comments

@spillai
Copy link
Contributor

spillai commented Apr 18, 2023 •
edited
Loading

Use gRPC gateway to serve REST API via reverse proxy.

References:
@spillai spillai changed the title Investigate REST/gRPC interface for inference service REST/gRPC gateway interface for inference service Sep 5, 2023
@spillai spillai added this to the NOS v0.0.11 milestone Sep 15, 2023
@spillai spillai added the feature New feature or request label Sep 15, 2023
@spillai spillai mentioned this issue Sep 21, 2023
Merged
4 tasks
@spillai spillai self-assigned this Sep 21, 2023
spillai added a commit that referenced this issue Sep 26, 2023
@spillai
Simple HTTP server with gRPC backend (#346)
1855981 
## Summary
REST API support for image/text models

## Related issues

#21 

## Checks

- [ ] `make lint`: I've run `make lint` to lint the changes in this PR.
- [ ] `make test`: I've made sure the tests (`make test-cpu` or `make
test`) are passing.
- Additional tests:
   - [ ] Benchmark tests (when contributing new models)
   - [ ] GPU/HW tests
@spillai
Copy link
Contributor Author

spillai commented Sep 26, 2023

Resolved in #346

@spillai spillai closed this as completed Sep 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@spillai spillai

Labels
feature New feature or request
Projects
None yet
Milestone
NOS v0.0.11
Development

No branches or pull requests
1 participant
@spillai