Evaluate Profile-Guided Optimization (PGO)

[zamazan4ik]

Hi!

Recently I checked Profile-Guided Optimization (PGO) improvements on multiple projects. The results are here.

Since PGO showed measurable improvements in many loads (including many databases) I think it could be useful to check PGO on arroyo as well.

We need to perform PGO benchmarks on arroyo. And if it shows improvements - add a note about possible improvements arroyo performance with PGO. Providing an easier way (e.g. a build option) to build scripts with PGO can be useful for the end-users too. For the Rust projects I recommend starting with https://github.com/Kobzol/cargo-pgo .

[jacksonrnewhouse]

Hi there, thanks for reaching out. I think we'll want to explore this down the line, as long-running streaming applications are a great place to do PGO. That being said, right now the focus is more on extending capabilities than improving performance. That being said, happy to chat if you'd like to get started on this yourself.