Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regression: publisher gRPC max recv set to 4MB #453

Closed
dpcollins-google opened this issue Jan 29, 2019 · 2 comments
Closed

Regression: publisher gRPC max recv set to 4MB #453

dpcollins-google opened this issue Jan 29, 2019 · 2 comments
Assignees
Labels
api: pubsub Issues related to the googleapis/nodejs-pubsub API. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. 🚨 This issue needs some love. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@dpcollins-google
Copy link

Environment details

  • OS: Any (both OSX and ubuntu running on compute engine)
  • Node.js version: 10 and 11
  • npm version:
  • @google-cloud/pubsub version: 0.23.0, 0.24.0

Steps to reproduce

  1. Create a publisher which publishes continuously until a certain amount of bytes are outstanding (50MB for example)
  2. Receive error from grpc channel Unhandled Rejection at: Promise Promise {
    Jan 29 18:22:29 cps-loadtest-cps-gcloud-node-publisher-16-12x3 startup-script: INFO startup-script-url: { Error: 8 RESOURCE_EXHAUSTED: Received message larger than max (7730750 vs. 4194304)
    Jan 29 18:22:29 cps-loadtest-cps-gcloud-node-publisher-16-12x3 startup-script: INFO startup-script-url: at Object.exports.createStatusError (/tmp/tmp.YqF8Ra5zwY/node_src/node_modules/grpc/src/common.js:91:15)
    Jan 29 18:22:29 cps-loadtest-cps-gcloud-node-publisher-16-12x3 startup-script: INFO startup-script-url: at Object.onReceiveStatus (/tmp/tmp.YqF8Ra5zwY/node_src/node_modules/grpc/src/client_interceptors.js:1204:28)
    Jan 29 18:22:29 cps-loadtest-cps-gcloud-node-publisher-16-12x3 startup-script: INFO startup-script-url: at InterceptingListener._callNext (/tmp/tmp.YqF8Ra5zwY/node_src/node_modules/grpc/src/client_interceptors.js:568:42)
    Jan 29 18:22:29 cps-loadtest-cps-gcloud-node-publisher-16-12x3 startup-script: INFO startup-script-url: at InterceptingListener.onReceiveStatus (/tmp/tmp.YqF8Ra5zwY/node_src/node_modules/grpc/src/client_interceptors.js:618:8)
    Jan 29 18:22:29 cps-loadtest-cps-gcloud-node-publisher-16-12x3 startup-script: INFO startup-script-url: at callback (/tmp/tmp.YqF8Ra5zwY/node_src/node_modules/grpc/src/client_interceptors.js:845:24)

This was previously addressed in googleapis/google-cloud-node#2190, and appears to be a regression from that.

@callmehiphop callmehiphop self-assigned this Jan 29, 2019
@callmehiphop callmehiphop added priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Jan 29, 2019
@callmehiphop
Copy link
Contributor

Looks like we forgot to remove the bound when we converted from plain grpc to gax. I'll get a fix out asap but in the meantime you should be able to do this

const pubsub = new PubSub({
  'grpc.max_send_message_length': -1,
});

@callmehiphop
Copy link
Contributor

The fix for this is now available in v0.24.1

@google-cloud-label-sync google-cloud-label-sync bot added the api: pubsub Issues related to the googleapis/nodejs-pubsub API. label Jan 31, 2020
@yoshi-automation yoshi-automation added the 🚨 This issue needs some love. label Apr 6, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: pubsub Issues related to the googleapis/nodejs-pubsub API. priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. 🚨 This issue needs some love. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Development

No branches or pull requests

3 participants