Skip to content

[VL][CI] Fix JVM heap OOM in TPC-DS baseline test#10681

Merged
philo-he merged 1 commit intoapache:mainfrom
philo-he:fix-heap-oom
Sep 11, 2025
Merged

[VL][CI] Fix JVM heap OOM in TPC-DS baseline test#10681
philo-he merged 1 commit intoapache:mainfrom
philo-he:fix-heap-oom

Conversation

@philo-he
Copy link
Copy Markdown
Member

@philo-he philo-he commented Sep 11, 2025

What changes are proposed in this pull request?

Fix #10680, which occasionally happens.

How was this patch tested?

CI.

@github-actions github-actions Bot added the INFRA label Sep 11, 2025
&& GLUTEN_IT_JVM_ARGS=-Xmx5G sbin/gluten-it.sh queries-compare \
--local --preset=velox --benchmark-type=h --error-on-memleak --off-heap-size=10g -s=1.0 --threads=16 --iterations=1 \
&& GLUTEN_IT_JVM_ARGS=-Xmx5G sbin/gluten-it.sh queries-compare \
&& GLUTEN_IT_JVM_ARGS=-Xmx6G sbin/gluten-it.sh queries-compare \
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Was 6G tested locally, and should we modify other workflows (there are more 5Gs)?

We haven't got chance to figure out why the heap memory got insufficient suddenly. It was enough back then.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@zhztheplayer, it was not tested locally. Since I observed this issue only happens in DS test, maybe, we can just change DS related setting?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SGTM.

@philo-he philo-he merged commit 906caef into apache:main Sep 11, 2025
48 checks passed
@philo-he philo-he deleted the fix-heap-oom branch September 11, 2025 14:56
kevinwilfong pushed a commit to kevinwilfong/incubator-gluten that referenced this pull request Sep 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[VL] JVM heap OOM in CI TPC-DS baseline test

2 participants