Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

There is no setting that allows increasing the limits of GRPC Server #183

Closed
ldcastell opened this issue Jul 6, 2018 · 3 comments
Closed

Comments

@ldcastell
Copy link

ldcastell commented Jul 6, 2018

Currently if you send a request that exceedis the configured maximum frame limit of 4194304 to the GRPC server of your deployed model there's now way you can change this setting to increase the frame limit

io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED: 

io.grpc.netty.NettyServerStream$TransportState: Frame size 10869161 exceeds maximum: 4194304.
@ukclivecox
Copy link
Contributor

We are working to allow extra configuration via annotations in the SeldonDeployment and this will be one such setting.

@ukclivecox
Copy link
Contributor

This work is now completed and is in master. The docs can be found here
You can test by using the development version images in master (0.2.3-SNAPSHOT) and the 0.2-SNAPSHOT python wrappers.

@ldcastell
Copy link
Author

Thanks @cliveseldon I will give it a try!

agrski pushed a commit that referenced this issue Dec 2, 2022
* add utility to convert versioned model name

* return a copy of original proto message
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants