Skip to content

Add Hive full-flow benchmark helpers#61625

Closed
xylaaaaa wants to merge 21 commits intoapache:masterfrom
xylaaaaa:draft/hive-tez-fullflow-poc
Closed

Add Hive full-flow benchmark helpers#61625
xylaaaaa wants to merge 21 commits intoapache:masterfrom
xylaaaaa:draft/hive-tez-fullflow-poc

Conversation

@xylaaaaa
Copy link
Contributor

This draft PR adds helper scripts for comparing current Hive3 and Tez cold-start full flows.

Included:

  • current Hive3 full-flow POC script
  • Tez full-flow POC script
  • wrapper benchmark script for current-vs-tez full-flow comparison

Notes:

  • The Tez execution path has been validated with a real insert/select workflow.
  • Full-flow benchmarking is still sensitive to machine disk and Docker environment stability, so this PR is intentionally marked draft.

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@xylaaaaa
Copy link
Contributor Author

Superseded by #61639. This new PR is based on master and only contains the Hive3 Tez config change.

@xylaaaaa xylaaaaa closed this Mar 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants