diff --git a/site/content/arangodb/3.12/develop/http-api/indexes/inverted.md b/site/content/arangodb/3.12/develop/http-api/indexes/inverted.md index 2e050c3320..d2c5939c25 100644 --- a/site/content/arangodb/3.12/develop/http-api/indexes/inverted.md +++ b/site/content/arangodb/3.12/develop/http-api/indexes/inverted.md @@ -537,7 +537,7 @@ paths: compaction operations are governed by `consolidationIntervalMsec` and the candidates for compaction are selected via `consolidationPolicy`. type: integer - default: 1000 + default: 5000 consolidationPolicy: description: | The consolidation policy to apply for selecting which segments should be merged. @@ -570,24 +570,24 @@ paths: Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. type: integer - default: 2097152 + default: 25165824 segmentsBytesMax: description: | The maximum allowed size of all consolidated segments in bytes. type: integer - default: 5368709120 + default: 8589934592 segmentsMax: description: | The maximum number of segments that are evaluated as candidates for consolidation. type: integer - default: 10 + default: 200 segmentsMin: description: | The minimum number of segments that are evaluated as candidates for consolidation. type: integer - default: 1 + default: 50 minScore: description: | Filter out consolidation candidates with a score less than this. diff --git a/site/content/arangodb/3.12/develop/http-api/views/arangosearch-views.md b/site/content/arangodb/3.12/develop/http-api/views/arangosearch-views.md index c8f8fd9dba..2f33e5c772 100644 --- a/site/content/arangodb/3.12/develop/http-api/views/arangosearch-views.md +++ b/site/content/arangodb/3.12/develop/http-api/views/arangosearch-views.md @@ -302,7 +302,7 @@ paths: compaction operations are governed by `consolidationIntervalMsec` and the candidates for compaction are selected via `consolidationPolicy`. type: integer - default: 10000 + default: 5000 consolidationPolicy: description: | The consolidation policy to apply for selecting which segments should be merged. @@ -351,24 +351,24 @@ paths: Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. type: integer - default: 2097152 + default: 25165824 segmentsBytesMax: description: | Maximum allowed size of all consolidated segments in bytes. type: integer - default: 5368709120 + default: 8589934592 segmentsMax: description: | The maximum number of segments that are evaluated as candidates for consolidation. type: integer - default: 10 + default: 200 segmentsMin: description: | The minimum number of segments that are evaluated as candidates for consolidation type: integer - default: 1 + default: 50 minScore: description: | Filter out consolidation candidates with a score less than this. @@ -1398,7 +1398,7 @@ paths: compaction operations are governed by `consolidationIntervalMsec` and the candidates for compaction are selected via `consolidationPolicy`. type: integer - default: 10000 + default: 5000 consolidationPolicy: description: | The consolidation policy to apply for selecting which segments should be merged. @@ -1447,24 +1447,24 @@ paths: Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. type: integer - default: 2097152 + default: 25165824 segmentsBytesMax: description: | Maximum allowed size of all consolidated segments in bytes. type: integer - default: 5368709120 + default: 8589934592 segmentsMax: description: | The maximum number of segments that are evaluated as candidates for consolidation. type: integer - default: 10 + default: 200 segmentsMin: description: | The minimum number of segments that are evaluated as candidates for consolidation type: integer - default: 1 + default: 50 minScore: description: | Filter out consolidation candidates with a score less than this. @@ -1955,24 +1955,24 @@ paths: Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. type: integer - default: 2097152 + default: 25165824 segmentsBytesMax: description: | Maximum allowed size of all consolidated segments in bytes. type: integer - default: 5368709120 + default: 8589934592 segmentsMax: description: | The maximum number of segments that are evaluated as candidates for consolidation. type: integer - default: 10 + default: 200 segmentsMin: description: | The minimum number of segments that are evaluated as candidates for consolidation type: integer - default: 1 + default: 50 minScore: description: | Filter out consolidation candidates with a score less than this. diff --git a/site/content/arangodb/3.12/indexes-and-search/arangosearch/arangosearch-views-reference.md b/site/content/arangodb/3.12/indexes-and-search/arangosearch/arangosearch-views-reference.md index 758d758003..036758127f 100644 --- a/site/content/arangodb/3.12/indexes-and-search/arangosearch/arangosearch-views-reference.md +++ b/site/content/arangodb/3.12/indexes-and-search/arangosearch/arangosearch-views-reference.md @@ -398,7 +398,7 @@ of removing unused segments after release of internal resources. > subsequent ArangoDB transactions. In-progress ArangoDB transactions > still continue to return a repeatable-read state. -- **consolidationIntervalMsec** (_optional_; type: `integer`; default: `1000`; +- **consolidationIntervalMsec** (_optional_; type: `integer`; default: `5000`; to disable use: `0`) Wait at least this many milliseconds between applying `consolidationPolicy` to @@ -483,19 +483,19 @@ is used by these writers (in terms of "writers pool") one can use `consolidationPolicy` properties for `"tier"` type: - - **segmentsMin** (_optional_; type: `integer`; default: `1`) + - **segmentsMin** (_optional_; type: `integer`; default: `50`) The minimum number of segments that are evaluated as candidates for consolidation. - - **segmentsMax** (_optional_; type: `integer`; default: `10`) + - **segmentsMax** (_optional_; type: `integer`; default: `200`) The maximum number of segments that are evaluated as candidates for consolidation. - - **segmentsBytesMax** (_optional_; type: `integer`; default: `5368709120`) + - **segmentsBytesMax** (_optional_; type: `integer`; default: `8589934592`) Maximum allowed size of all consolidated segments in bytes. - - **segmentsBytesFloor** (_optional_; type: `integer`; default: `2097152`) + - **segmentsBytesFloor** (_optional_; type: `integer`; default: `25165824`) Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. diff --git a/site/content/arangodb/3.12/release-notes/version-3.12/api-changes-in-3-12.md b/site/content/arangodb/3.12/release-notes/version-3.12/api-changes-in-3-12.md index 42bb95f864..8cc010cc0a 100644 --- a/site/content/arangodb/3.12/release-notes/version-3.12/api-changes-in-3-12.md +++ b/site/content/arangodb/3.12/release-notes/version-3.12/api-changes-in-3-12.md @@ -340,6 +340,8 @@ for related API changes. #### View API +##### `optimizeTopK` property for `arangosearch` Views + Views of type `arangosearch` accept a new `optimizeTopK` View property for the ArangoSearch WAND optimization. It is an immutable array of strings, optional, and defaults to `[]`. @@ -347,6 +349,20 @@ and defaults to `[]`. See the [`optimizeTopK` View property](../../indexes-and-search/arangosearch/arangosearch-views-reference.md#view-properties) for details. +##### Changed consolidation defaults for `arangosearch` Views + +Introduced in: v3.12.6 + +The default values for consolidating `arangosearch` Views have been changed. +By consolidating less often and with more data, less file descriptors are used. + +- `consolidationIntervalMsec` increased from `1000` to `5000` +- `consolidationPolicy` (with `type` set to `tier`): + - `segmentsMin` increased from `1` to `50` + - `segmentsMax` increased from `10` to `200` + - `segmentsBytesMax` increased from `5368709120` (5 GiB) to `8589934592` (8 GiB) + - `segmentsBytesFloor` increased from `2097152` (2 MiB) to `25165824` (24 MiB) + #### Document API The following endpoints accept a new `versionAttribute` query parameter that adds @@ -463,7 +479,7 @@ add the `withHidden=true` query parameter to the call of the endpoint. curl "http://localhost:8529/_api/index?collection=myCollection&withHidden=true" ``` -#### Vector indexes +##### Vector indexes Introduced in: v3.12.4 @@ -471,6 +487,20 @@ A new `vector` index type has been added. See [HTTP interface for vector indexes](../../develop/http-api/indexes/vector.md) for details. +##### Changed consolidation defaults for inverted indexes + +Introduced in: v3.12.6 + +The default values for consolidating inverted indexes have been changed. +By consolidating less often and with more data, less file descriptors are used. + +- `consolidationIntervalMsec` increased from `1000` to `5000` +- `consolidationPolicy` (with `type` set to `tier`): + - `segmentsMin` increased from `1` to `50` + - `segmentsMax` increased from `10` to `200` + - `segmentsBytesMax` increased from `5368709120` (5 GiB) to `8589934592` (8 GiB) + - `segmentsBytesFloor` increased from `2097152` (2 MiB) to `25165824` (24 MiB) + #### Optimizer rule descriptions Introduced in: v3.10.9, v3.11.2 diff --git a/site/content/arangodb/3.12/release-notes/version-3.12/incompatible-changes-in-3-12.md b/site/content/arangodb/3.12/release-notes/version-3.12/incompatible-changes-in-3-12.md index 5eb6e159ec..959cea82cf 100644 --- a/site/content/arangodb/3.12/release-notes/version-3.12/incompatible-changes-in-3-12.md +++ b/site/content/arangodb/3.12/release-notes/version-3.12/incompatible-changes-in-3-12.md @@ -979,6 +979,21 @@ header or an invalid URL, it now sends a response with an error object instead of closing the connection, e.g. that the URL is corrupt with an HTTP status code of 400. +## Changed consolidation defaults for inverted indexes and `arangosearch` Views + +Introduced in: v3.12.6 + +The default values for consolidating inverted indexes as well as +`arangosearch` Views have been changed. By consolidating less often and with +more data, less file descriptors are used. + +- `consolidationIntervalMsec` increased from `1000` to `5000` +- `consolidationPolicy` (with `type` set to `tier`): + - `segmentsMin` increased from `1` to `50` + - `segmentsMax` increased from `10` to `200` + - `segmentsBytesMax` increased from `5368709120` (5 GiB) to `8589934592` (8 GiB) + - `segmentsBytesFloor` increased from `2097152` (2 MiB) to `25165824` (24 MiB) + ## HTTP RESTful API ### JavaScript-based traversal using `/_api/traversal` removed diff --git a/site/content/arangodb/4.0/develop/http-api/indexes/inverted.md b/site/content/arangodb/4.0/develop/http-api/indexes/inverted.md index 2e050c3320..d2c5939c25 100644 --- a/site/content/arangodb/4.0/develop/http-api/indexes/inverted.md +++ b/site/content/arangodb/4.0/develop/http-api/indexes/inverted.md @@ -537,7 +537,7 @@ paths: compaction operations are governed by `consolidationIntervalMsec` and the candidates for compaction are selected via `consolidationPolicy`. type: integer - default: 1000 + default: 5000 consolidationPolicy: description: | The consolidation policy to apply for selecting which segments should be merged. @@ -570,24 +570,24 @@ paths: Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. type: integer - default: 2097152 + default: 25165824 segmentsBytesMax: description: | The maximum allowed size of all consolidated segments in bytes. type: integer - default: 5368709120 + default: 8589934592 segmentsMax: description: | The maximum number of segments that are evaluated as candidates for consolidation. type: integer - default: 10 + default: 200 segmentsMin: description: | The minimum number of segments that are evaluated as candidates for consolidation. type: integer - default: 1 + default: 50 minScore: description: | Filter out consolidation candidates with a score less than this. diff --git a/site/content/arangodb/4.0/develop/http-api/views/arangosearch-views.md b/site/content/arangodb/4.0/develop/http-api/views/arangosearch-views.md index c8f8fd9dba..2f33e5c772 100644 --- a/site/content/arangodb/4.0/develop/http-api/views/arangosearch-views.md +++ b/site/content/arangodb/4.0/develop/http-api/views/arangosearch-views.md @@ -302,7 +302,7 @@ paths: compaction operations are governed by `consolidationIntervalMsec` and the candidates for compaction are selected via `consolidationPolicy`. type: integer - default: 10000 + default: 5000 consolidationPolicy: description: | The consolidation policy to apply for selecting which segments should be merged. @@ -351,24 +351,24 @@ paths: Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. type: integer - default: 2097152 + default: 25165824 segmentsBytesMax: description: | Maximum allowed size of all consolidated segments in bytes. type: integer - default: 5368709120 + default: 8589934592 segmentsMax: description: | The maximum number of segments that are evaluated as candidates for consolidation. type: integer - default: 10 + default: 200 segmentsMin: description: | The minimum number of segments that are evaluated as candidates for consolidation type: integer - default: 1 + default: 50 minScore: description: | Filter out consolidation candidates with a score less than this. @@ -1398,7 +1398,7 @@ paths: compaction operations are governed by `consolidationIntervalMsec` and the candidates for compaction are selected via `consolidationPolicy`. type: integer - default: 10000 + default: 5000 consolidationPolicy: description: | The consolidation policy to apply for selecting which segments should be merged. @@ -1447,24 +1447,24 @@ paths: Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. type: integer - default: 2097152 + default: 25165824 segmentsBytesMax: description: | Maximum allowed size of all consolidated segments in bytes. type: integer - default: 5368709120 + default: 8589934592 segmentsMax: description: | The maximum number of segments that are evaluated as candidates for consolidation. type: integer - default: 10 + default: 200 segmentsMin: description: | The minimum number of segments that are evaluated as candidates for consolidation type: integer - default: 1 + default: 50 minScore: description: | Filter out consolidation candidates with a score less than this. @@ -1955,24 +1955,24 @@ paths: Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. type: integer - default: 2097152 + default: 25165824 segmentsBytesMax: description: | Maximum allowed size of all consolidated segments in bytes. type: integer - default: 5368709120 + default: 8589934592 segmentsMax: description: | The maximum number of segments that are evaluated as candidates for consolidation. type: integer - default: 10 + default: 200 segmentsMin: description: | The minimum number of segments that are evaluated as candidates for consolidation type: integer - default: 1 + default: 50 minScore: description: | Filter out consolidation candidates with a score less than this. diff --git a/site/content/arangodb/4.0/indexes-and-search/arangosearch/arangosearch-views-reference.md b/site/content/arangodb/4.0/indexes-and-search/arangosearch/arangosearch-views-reference.md index 758d758003..036758127f 100644 --- a/site/content/arangodb/4.0/indexes-and-search/arangosearch/arangosearch-views-reference.md +++ b/site/content/arangodb/4.0/indexes-and-search/arangosearch/arangosearch-views-reference.md @@ -398,7 +398,7 @@ of removing unused segments after release of internal resources. > subsequent ArangoDB transactions. In-progress ArangoDB transactions > still continue to return a repeatable-read state. -- **consolidationIntervalMsec** (_optional_; type: `integer`; default: `1000`; +- **consolidationIntervalMsec** (_optional_; type: `integer`; default: `5000`; to disable use: `0`) Wait at least this many milliseconds between applying `consolidationPolicy` to @@ -483,19 +483,19 @@ is used by these writers (in terms of "writers pool") one can use `consolidationPolicy` properties for `"tier"` type: - - **segmentsMin** (_optional_; type: `integer`; default: `1`) + - **segmentsMin** (_optional_; type: `integer`; default: `50`) The minimum number of segments that are evaluated as candidates for consolidation. - - **segmentsMax** (_optional_; type: `integer`; default: `10`) + - **segmentsMax** (_optional_; type: `integer`; default: `200`) The maximum number of segments that are evaluated as candidates for consolidation. - - **segmentsBytesMax** (_optional_; type: `integer`; default: `5368709120`) + - **segmentsBytesMax** (_optional_; type: `integer`; default: `8589934592`) Maximum allowed size of all consolidated segments in bytes. - - **segmentsBytesFloor** (_optional_; type: `integer`; default: `2097152`) + - **segmentsBytesFloor** (_optional_; type: `integer`; default: `25165824`) Defines the value (in bytes) to treat all smaller segments as equal for consolidation selection. diff --git a/site/content/arangodb/4.0/release-notes/version-3.12/api-changes-in-3-12.md b/site/content/arangodb/4.0/release-notes/version-3.12/api-changes-in-3-12.md index 42bb95f864..8cc010cc0a 100644 --- a/site/content/arangodb/4.0/release-notes/version-3.12/api-changes-in-3-12.md +++ b/site/content/arangodb/4.0/release-notes/version-3.12/api-changes-in-3-12.md @@ -340,6 +340,8 @@ for related API changes. #### View API +##### `optimizeTopK` property for `arangosearch` Views + Views of type `arangosearch` accept a new `optimizeTopK` View property for the ArangoSearch WAND optimization. It is an immutable array of strings, optional, and defaults to `[]`. @@ -347,6 +349,20 @@ and defaults to `[]`. See the [`optimizeTopK` View property](../../indexes-and-search/arangosearch/arangosearch-views-reference.md#view-properties) for details. +##### Changed consolidation defaults for `arangosearch` Views + +Introduced in: v3.12.6 + +The default values for consolidating `arangosearch` Views have been changed. +By consolidating less often and with more data, less file descriptors are used. + +- `consolidationIntervalMsec` increased from `1000` to `5000` +- `consolidationPolicy` (with `type` set to `tier`): + - `segmentsMin` increased from `1` to `50` + - `segmentsMax` increased from `10` to `200` + - `segmentsBytesMax` increased from `5368709120` (5 GiB) to `8589934592` (8 GiB) + - `segmentsBytesFloor` increased from `2097152` (2 MiB) to `25165824` (24 MiB) + #### Document API The following endpoints accept a new `versionAttribute` query parameter that adds @@ -463,7 +479,7 @@ add the `withHidden=true` query parameter to the call of the endpoint. curl "http://localhost:8529/_api/index?collection=myCollection&withHidden=true" ``` -#### Vector indexes +##### Vector indexes Introduced in: v3.12.4 @@ -471,6 +487,20 @@ A new `vector` index type has been added. See [HTTP interface for vector indexes](../../develop/http-api/indexes/vector.md) for details. +##### Changed consolidation defaults for inverted indexes + +Introduced in: v3.12.6 + +The default values for consolidating inverted indexes have been changed. +By consolidating less often and with more data, less file descriptors are used. + +- `consolidationIntervalMsec` increased from `1000` to `5000` +- `consolidationPolicy` (with `type` set to `tier`): + - `segmentsMin` increased from `1` to `50` + - `segmentsMax` increased from `10` to `200` + - `segmentsBytesMax` increased from `5368709120` (5 GiB) to `8589934592` (8 GiB) + - `segmentsBytesFloor` increased from `2097152` (2 MiB) to `25165824` (24 MiB) + #### Optimizer rule descriptions Introduced in: v3.10.9, v3.11.2 diff --git a/site/content/arangodb/4.0/release-notes/version-3.12/incompatible-changes-in-3-12.md b/site/content/arangodb/4.0/release-notes/version-3.12/incompatible-changes-in-3-12.md index 5eb6e159ec..959cea82cf 100644 --- a/site/content/arangodb/4.0/release-notes/version-3.12/incompatible-changes-in-3-12.md +++ b/site/content/arangodb/4.0/release-notes/version-3.12/incompatible-changes-in-3-12.md @@ -979,6 +979,21 @@ header or an invalid URL, it now sends a response with an error object instead of closing the connection, e.g. that the URL is corrupt with an HTTP status code of 400. +## Changed consolidation defaults for inverted indexes and `arangosearch` Views + +Introduced in: v3.12.6 + +The default values for consolidating inverted indexes as well as +`arangosearch` Views have been changed. By consolidating less often and with +more data, less file descriptors are used. + +- `consolidationIntervalMsec` increased from `1000` to `5000` +- `consolidationPolicy` (with `type` set to `tier`): + - `segmentsMin` increased from `1` to `50` + - `segmentsMax` increased from `10` to `200` + - `segmentsBytesMax` increased from `5368709120` (5 GiB) to `8589934592` (8 GiB) + - `segmentsBytesFloor` increased from `2097152` (2 MiB) to `25165824` (24 MiB) + ## HTTP RESTful API ### JavaScript-based traversal using `/_api/traversal` removed