Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Postgres listener error handling logs in an infinite loop #311

Closed
warent opened this issue Feb 9, 2022 · 6 comments
Closed

Postgres listener error handling logs in an infinite loop #311

warent opened this issue Feb 9, 2022 · 6 comments
Assignees
Labels
bug Something isn't working integrations Related to integrations

Comments

@warent
Copy link

warent commented Feb 9, 2022

This code here:

case err := <-listener.Errors:
log.Printf("Postgres listen error: %v\n", err)

Somehow if the postgres connection is closed, it gets caught in an infinite loop and logs forever.

I had this running in GCP and it was logging about 500k times per minute. This ended up costing me about $1000 over a few days before I caught it and made it stop.

Screen Shot 2022-02-08 at 5 34 27 PM

153105931-4bdbec79-e5a5-474b-a5ca-8ab196974fa1

@xchopin
Copy link

xchopin commented Feb 9, 2022

ouch

@kennethkoontz
Copy link

Oh no!

@estradino estradino added bug Something isn't working integrations Related to integrations labels Feb 9, 2022
@estradino
Copy link
Contributor

Damn. This is the most expensive bug in OpenReplay so far. Sorry for that.
We'll get it fixed in the upcoming release (v1.5.0).

@estradino estradino assigned tahayk and unassigned PandaCodes Feb 9, 2022
@estradino
Copy link
Contributor

Fixed in OpenReplay v1.5.0.

@warent
Copy link
Author

warent commented Feb 11, 2022

Thanks for the quick followup @estradino :) Good news Google reviewed this issue and refunded the charge. All is well

@estradino
Copy link
Contributor

Great customer support from Google. Thanks very much for spotting and reporting the issue @warent!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working integrations Related to integrations
Projects
None yet
Development

No branches or pull requests

6 participants