Skip to content

Clarify compaction docs.#14225

Merged
gianm merged 4 commits intoapache:masterfrom
gianm:clarify-compact-doc
Jun 23, 2023
Merged

Clarify compaction docs.#14225
gianm merged 4 commits intoapache:masterfrom
gianm:clarify-compact-doc

Conversation

@gianm
Copy link
Contributor

@gianm gianm commented May 8, 2023

The prior wording made it sound like segmentGranularity, queryGranularity, and rollup are always required for granularitySpec. They are not required, but they are strongly recommended. The adjusted wording hopefully does a better job of making that clear.

The prior wording made it sound like segmentGranularity, queryGranularity,
and rollup are always required for granularitySpec. They are not required,
but they are strongly recommended. The adjusted wording hopefully does
a better job of making that clear.
Copy link
Contributor

@kfaraz kfaraz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor suggestions, but they are optional.

Compaction tasks fetch all [relevant segments](compaction.md#compaction-io-configuration) prior to launching any subtasks,
_unless_ the following items are all set. It is strongly recommended to set all of these items to maximize performance
and minimize disk usage of the `compact` tasks launched by auto-compaction:
_unless_ the following items are all set. It is strongly recommended to set all of these items to non-null values to
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe use the word field instead of item.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think for JSON prefer properties over item.

maximize performance and minimize disk usage of the `compact` tasks launched by auto-compaction:

- [`granularitySpec`](compaction.md#compaction-granularity-spec). All three values must be set to non-null values: `segmentGranularity`, `queryGranularity`, and `rollup`.
- [`granularitySpec`](compaction.md#compaction-granularity-spec), including all three of `segmentGranularity`, `queryGranularity`, and `rollup`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Slight rephrase:

Suggested change
- [`granularitySpec`](compaction.md#compaction-granularity-spec), including all three of `segmentGranularity`, `queryGranularity`, and `rollup`
- [`granularitySpec`](compaction.md#compaction-granularity-spec), with non-null values for each of `segmentGranularity`, `queryGranularity`, and `rollup`.

@@ -116,10 +116,10 @@ The following properties are automatically set by the Coordinator:
* `context`: Set according to the user-provided `taskContext`.

Compaction tasks fetch all [relevant segments](compaction.md#compaction-io-configuration) prior to launching any subtasks,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Compaction tasks fetch all [relevant segments](compaction.md#compaction-io-configuration) prior to launching any subtasks,
Compaction tasks typically fetch all [relevant segments](compaction.md#compaction-io-configuration) prior to launching any subtasks,

Compaction tasks fetch all [relevant segments](compaction.md#compaction-io-configuration) prior to launching any subtasks,
_unless_ the following items are all set. It is strongly recommended to set all of these items to maximize performance
and minimize disk usage of the `compact` tasks launched by auto-compaction:
_unless_ the following items are all set. It is strongly recommended to set all of these items to non-null values to
Copy link
Contributor

@kfaraz kfaraz May 9, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
_unless_ the following items are all set. It is strongly recommended to set all of these items to non-null values to
_unless_ the following properties are all set to non-null values. It is strongly recommended to set them to

cs minor edit to comment.

@gianm gianm merged commit 1d6c965 into apache:master Jun 23, 2023
@gianm gianm deleted the clarify-compact-doc branch June 23, 2023 22:24
@abhishekagarwal87 abhishekagarwal87 added this to the 27.0 milestone Jul 19, 2023
sergioferragut pushed a commit to sergioferragut/druid that referenced this pull request Jul 21, 2023
* Clarify compaction docs.

The prior wording made it sound like segmentGranularity, queryGranularity,
and rollup are always required for granularitySpec. They are not required,
but they are strongly recommended. The adjusted wording hopefully does
a better job of making that clear.

* Fix link.

* Wording adjustments.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants