Performance loss since @grpc/grpc-js version 1.6.8

[antonstefer]

Problem description

I use @google-cloud/bigtable which depends on @grpc/grpc-js through grpc-gcp and google-gax (maybe in more ways). When updating from 1.6.7 to 1.6.8 or any version above that, bigtable calls (especially ReadRows queries) get significantly slower (about 100% on average).

Reproduction steps

Use bigtable with both of the above versions and perform ReadRows queries on tables.

Environment

• Google Cloud, Kubernetes Cluster, Container-Optimized OS from Google
• node:16-alpine docker image
• @grpc/grpc-js@1.6.8 or above
• google managed bigtable instance

Additional context

As this is only a performance issue we do not see any error logs. We have created trace analysis reports using the google cloud platform which show the difference in execution time.

before:

after:

[murgatroid99]

I published grpc-js version 1.7.1 with a change that will hopefully improve this situation. Please try it out.

[antonstefer]

It works, thank you so much!