-
Notifications
You must be signed in to change notification settings - Fork 75
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[surfacer.postgres] Postgresql surfacer bulk inserts #717
[surfacer.postgres] Postgresql surfacer bulk inserts #717
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @markoposavec for this PR. Please take a look at the inline comments.
For some reason made a rebase and it shows changes from the other commit about tls. |
That's weird. Can you try the following:
I am not sure if above will work, might need to check internet :) |
Co-authored-by: Manu Garg <manugarg@gmail.com>
Co-authored-by: Manu Garg <manugarg@gmail.com>
Co-authored-by: Manu Garg <manugarg@gmail.com>
…loudprober#716) - This is important for Windows tests where deleting the test binary fails if it's still executing (for testing external probe process). - We use a temp pids file to collect the pids of the started processes and kill those pids before exiting the test.
423d808
to
66fdd7c
Compare
that fixed the issue, thanks 😄 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One minor suggestion. Looks good otherwise.
Hello!
I've added option to add bulk writing into postgres database. Currently all metrics from one metrics event object are written in one transaction which was very slow in my use case because of slow connections towards database. I've added batching of metrics events into one transaction. This change improved the speed in my use case by ~10x.
With default values system is working as it was before, event metrics are sent one by one to database.
Let me know if I should change anything,
Thanks!