Skip to content

CI: Fix recurring and dispatch JMH benchmarks#15488

Closed
naamamaoz wants to merge 0 commit intoapache:mainfrom
naamamaoz:main
Closed

CI: Fix recurring and dispatch JMH benchmarks#15488
naamamaoz wants to merge 0 commit intoapache:mainfrom
naamamaoz:main

Conversation

@naamamaoz
Copy link

The JMH benchmark workflows have been broken since the default Spark version moved past 3.5.

This PR fixes three issues:

  • Pass -DsparkVersions=3.5 so the Spark 3.5 project is included in the build
  • Wire extraJvmArgs from build.gradle into jmh.gradle to pass --add-opens flags needed on JDK 17+
  • Use unique artifact names per matrix job and merge them, fixing upload-artifact@v4+ conflicts
  • Reduce JMH default heap from 32g to 8g, which stopped runner kills for memory-intensive benchmarks

AI was used to help identify the root causes.
All changes were verified by running the benchmarks end-to-end.

jmh.gradle Outdated
includeTests = true
humanOutputFile = file(jmhOutputPath)
jvmArgs = ['-Xmx32g']
jvmArgs = ['-Xmx8g'] + (project.property('extraJvmArgs') as List<String>)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this change doesn't seem related?

path: |
**/benchmark/*.txt

merge-results:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you please elaborate why this is needed now?

@nastra
Copy link
Contributor

nastra commented Mar 2, 2026

@naamamaoz you should be able to run these changes in your fork to verify that JMH benchmarks pass again. Can you please attach some links that show this works?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants