Skip to content

[Druid-30] OBSDATA-10784: Fix cc-druid distribution module build-time#353

Merged
Pinaki (pinaki-basu) merged 5 commits into30.0.1-confluentfrom
pinaki/build-times-cc-druid
Jul 3, 2025
Merged

[Druid-30] OBSDATA-10784: Fix cc-druid distribution module build-time#353
Pinaki (pinaki-basu) merged 5 commits into30.0.1-confluentfrom
pinaki/build-times-cc-druid

Conversation

@pinaki-basu
Copy link
Copy Markdown
Member

@pinaki-basu Pinaki (pinaki-basu) commented Jul 2, 2025

Description

Druid build times in confluentinc/cc-druid for Build And Test For Commercial had regressed to 75mins. Most of this was spent in building the distribution module which took around 48mins.

Logs : [INFO] distribution ....................................... SUCCESS [48:39 min]

Updates :

  • Explicitly use exec-maven-plugin >3.1.0 (earlier build versions used 1.6.0)
  • Pass the flag --no-default-hadoop which doesn't pull down the default hadoop version. This is tested earlier in Druid-28 clusters.

The build time for distribution is down to 2mins.

Logs : [INFO] distribution ....................................... SUCCESS [01:39 min]
Test semaphore job-id : https://semaphore.ci.confluent.io/jobs/5abbb9d6-a6a6-4ebf-9e39-4ac2b3fa5cf7

Total build time for Build And Test For Commercial is down to 23mins.

This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • a release note entry in the PR description.
  • added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
  • added or updated version, license, or notice information in licenses.yaml
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
  • added integration tests.
  • been tested in a test Druid cluster.

@pinaki-basu Pinaki (pinaki-basu) changed the title [WIP] OBSDATA-10784: Fix cc-druid distribution module build-time [Druid-30] OBSDATA-10784: Fix cc-druid distribution module build-time Jul 2, 2025
@pinaki-basu Pinaki (pinaki-basu) marked this pull request as ready for review July 2, 2025 19:33
@pinaki-basu Pinaki (pinaki-basu) requested a review from a team as a code owner July 2, 2025 19:33
@pinaki-basu Pinaki (pinaki-basu) merged commit d8125ca into 30.0.1-confluent Jul 3, 2025
2 checks passed
@pinaki-basu Pinaki (pinaki-basu) deleted the pinaki/build-times-cc-druid branch July 3, 2025 04:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants