Showing with 4,539 additions and 2,952 deletions.
  1. +1 −0 .ci/bwcVersions
  2. +0 −1 .ci/jobs.t/elastic+elasticsearch+multijob+packaging-tests-unix.yml
  3. +1 −1 .ci/jobs.t/elastic+elasticsearch+multijob+packaging-tests-windows.yml
  4. +0 −1 .ci/jobs.t/elastic+elasticsearch+multijob+platform-support-unix.yml
  5. +0 −1 .ci/jobs.t/elastic+elasticsearch+pull-request+packaging-tests-unix.yml
  6. +1 −1 .ci/jobs.t/elastic+elasticsearch+pull-request+packaging-tests-windows-sample.yml
  7. +1 −1 .ci/jobs.t/elastic+elasticsearch+pull-request+packaging-tests-windows.yml
  8. +1 −1 .ci/jobs.t/elastic+elasticsearch+pull-request+part-1-fips.yml
  9. +1 −1 .ci/jobs.t/elastic+elasticsearch+pull-request+part-2-fips.yml
  10. +1 −0 .ci/scripts/packaging-test.ps1
  11. +1 −1 buildSrc/version.properties
  12. +5 −1 client/rest-high-level/src/test/java/org/elasticsearch/client/ESRestHighLevelClientTestCase.java
  13. +2 −0 client/rest-high-level/src/test/java/org/elasticsearch/client/ReindexIT.java
  14. +1 −1 distribution/build.gradle
  15. +6 −0 docs/community-clients/index.asciidoc
  16. +3 −0 docs/java-rest/high-level/security/get-builtin-privileges.asciidoc
  17. +4 −2 docs/java-rest/high-level/security/get-privileges.asciidoc
  18. +2 −0 docs/java-rest/high-level/security/get-user-privileges.asciidoc
  19. +2 −0 docs/java-rest/high-level/security/has-privileges.asciidoc
  20. +3 −1 docs/painless/painless-guide/index.asciidoc
  21. +98 −0 docs/painless/painless-guide/painless-ingest.asciidoc
  22. +2 −4 docs/reference/aggregations/bucket.asciidoc
  23. +11 −4 docs/reference/aggregations/bucket/terms-aggregation.asciidoc
  24. +8 −2 docs/reference/api-conventions.asciidoc
  25. +5 −0 docs/reference/autoscaling/autoscaling-deciders.asciidoc
  26. +9 −0 docs/reference/autoscaling/deciders/frozen-existence-decider.asciidoc
  27. +3 −3 docs/reference/ccr/apis/follow/get-follow-stats.asciidoc
  28. +1 −1 docs/reference/ccr/getting-started.asciidoc
  29. BIN docs/reference/ccr/images/ccr-arch-central-reporting.png
  30. +7 −1 docs/reference/cluster/pending.asciidoc
  31. +4 −0 docs/reference/data-streams/change-mappings-and-settings.asciidoc
  32. +3 −3 docs/reference/docs/bulk.asciidoc
  33. +5 −5 docs/reference/docs/reindex.asciidoc
  34. +19 −0 docs/reference/eql/eql-apis.asciidoc
  35. +10 −1 docs/reference/eql/syntax.asciidoc
  36. +6 −8 docs/reference/getting-started.asciidoc
  37. +0 −518 docs/reference/glossary.asciidoc
  38. +1 −1 docs/reference/how-to/search-speed.asciidoc
  39. +0 −11 docs/reference/how-to/use-elasticsearch-for-time-series-data.asciidoc
  40. +12 −8 docs/reference/ilm/actions/ilm-searchable-snapshot.asciidoc
  41. +1 −1 docs/reference/ilm/example-index-lifecycle-policy.asciidoc
  42. +8 −9 docs/reference/ilm/ilm-overview.asciidoc
  43. +67 −0 docs/reference/ilm/set-up-lifecycle-policy.asciidoc
  44. +0 −2 docs/reference/index.asciidoc
  45. +13 −4 docs/reference/indices/clone-index.asciidoc
  46. +8 −11 docs/reference/indices/delete-index.asciidoc
  47. +2 −3 docs/reference/indices/recovery.asciidoc
  48. +1 −1 docs/reference/indices/split-index.asciidoc
  49. +1 −0 docs/reference/ingest/apis/enrich/index.asciidoc
  50. +6 −2 docs/reference/ingest/processors/geoip.asciidoc
  51. +1 −1 docs/reference/mapping/dynamic/templates.asciidoc
  52. +32 −0 docs/reference/mapping/runtime.asciidoc
  53. +1 −1 docs/reference/mapping/types/object.asciidoc
  54. +10 −6 docs/reference/ml/anomaly-detection/apis/update-job.asciidoc
  55. +13 −13 docs/reference/ml/anomaly-detection/ml-configuring-populations.asciidoc
  56. +1 −1 docs/reference/modules/indices/search-settings.asciidoc
  57. +13 −24 docs/reference/modules/node.asciidoc
  58. +8 −2 docs/reference/modules/threadpool.asciidoc
  59. +4 −4 docs/reference/monitoring/collecting-monitoring-data.asciidoc
  60. +1 −1 docs/reference/monitoring/configuring-filebeat.asciidoc
  61. +1 −1 docs/reference/monitoring/configuring-metricbeat.asciidoc
  62. +2 −2 docs/reference/query-dsl/query-string-query.asciidoc
  63. +6 −4 docs/reference/query-dsl/query-string-syntax.asciidoc
  64. +5 −0 docs/reference/redirects.asciidoc
  65. +1 −0 docs/reference/release-notes.asciidoc
  66. +43 −1 docs/reference/release-notes/7.13.asciidoc
  67. +3 −1 docs/reference/rest-api/index.asciidoc
  68. +6 −26 docs/reference/scripting/apis/create-stored-script-api.asciidoc
  69. +5 −0 docs/reference/scripting/apis/delete-stored-script-api.asciidoc
  70. +1 −1 docs/reference/scripting/apis/get-stored-script-api.asciidoc
  71. +2 −2 docs/reference/scripting/using.asciidoc
  72. +7 −21 docs/reference/search.asciidoc
  73. +163 −0 docs/reference/search/multi-search-template-api.asciidoc
  74. +3 −71 docs/reference/search/multi-search.asciidoc
  75. +1 −1 docs/reference/search/rank-eval.asciidoc
  76. +89 −0 docs/reference/search/render-search-template-api.asciidoc
  77. +148 −0 docs/reference/search/search-template-api.asciidoc
  78. +0 −725 docs/reference/search/search-template.asciidoc
  79. +168 −106 docs/reference/search/search-your-data/collapse-search-results.asciidoc
  80. +633 −0 docs/reference/search/search-your-data/search-template.asciidoc
  81. +1 −0 docs/reference/search/search-your-data/search-your-data.asciidoc
  82. +1 −0 docs/reference/search/search-your-data/sort-search-results.asciidoc
  83. +2 −2 docs/reference/search/suggesters/phrase-suggest.asciidoc
  84. +9 −13 docs/reference/settings/ml-settings.asciidoc
  85. +4 −2 docs/reference/snapshot-restore/apis/get-snapshot-api.asciidoc
  86. +4 −2 docs/reference/snapshot-restore/apis/get-snapshot-status-api.asciidoc
  87. +5 −1 docs/reference/snapshot-restore/apis/restore-snapshot-api.asciidoc
  88. +1 −1 docs/reference/snapshot-restore/apis/snapshot-restore-apis.asciidoc
  89. +5 −0 docs/reference/snapshot-restore/take-snapshot.asciidoc
  90. +41 −25 docs/reference/sql/functions/aggs.asciidoc
  91. +64 −58 docs/reference/sql/functions/date-time.asciidoc
  92. +9 −8 docs/reference/sql/functions/geo.asciidoc
  93. +10 −5 docs/reference/sql/functions/grouping.asciidoc
  94. +30 −30 docs/reference/sql/functions/math.asciidoc
  95. +49 −42 docs/reference/sql/functions/string.asciidoc
  96. +2 −2 docs/reference/sql/functions/type-conversion.asciidoc
  97. +1 −1 docs/reference/sql/language/data-types.asciidoc
  98. +7 −6 docs/reference/transform/examples.asciidoc
  99. +3 −1 docs/reference/upgrade/reindex_upgrade.asciidoc
  100. +34 −14 libs/grok/src/main/java/org/elasticsearch/grok/Grok.java
  101. +17 −5 libs/grok/src/test/java/org/elasticsearch/grok/GrokTests.java
  102. +1 −1 .../analysis-phonetic/src/main/java/org/elasticsearch/index/analysis/PhoneticTokenFilterFactory.java
  103. +0 −318 plugins/analysis-phonetic/src/main/java/org/elasticsearch/index/analysis/phonetic/Nysiis.java
  104. +1 −1 rest-api-spec/src/main/resources/rest-api-spec/api/render_search_template.json
  105. +2 −2 rest-api-spec/src/main/resources/rest-api-spec/api/security.get_user_privileges.json
  106. +13 −0 ...pi-spec/src/yamlRestTest/resources/rest-api-spec/test/search.aggregation/22_terms_disable_opt.yml
  107. +70 −0 rest-api-spec/src/yamlRestTest/resources/rest-api-spec/test/search.aggregation/230_composite.yml
  108. +2 −2 rest-api-spec/src/yamlRestTest/resources/rest-api-spec/test/search/350_point_in_time.yml
  109. +85 −0 server/src/internalClusterTest/java/org/elasticsearch/snapshots/BlobStoreIncrementalityIT.java
  110. +128 −112 server/src/main/java/org/apache/lucene/search/XMultiNormsLeafSimScorer.java
  111. +2 −1 server/src/main/java/org/elasticsearch/Version.java
  112. +2 −2 server/src/main/java/org/elasticsearch/action/fieldcaps/FieldCapabilitiesResponse.java
  113. +12 −0 server/src/main/java/org/elasticsearch/cluster/node/DiscoveryNodeFilters.java
  114. +2 −3 server/src/main/java/org/elasticsearch/common/lucene/search/function/FunctionScoreQuery.java
  115. +2 −2 server/src/main/java/org/elasticsearch/common/lucene/search/function/ScriptScoreQuery.java
  116. +5 −0 server/src/main/java/org/elasticsearch/indices/recovery/MultiChunkTransfer.java
  117. +12 −1 server/src/main/java/org/elasticsearch/indices/recovery/RecoverySourceHandler.java
  118. +20 −3 server/src/main/java/org/elasticsearch/indices/recovery/RemoteRecoveryTargetHandler.java
  119. +4 −3 server/src/main/java/org/elasticsearch/repositories/blobstore/BlobStoreRepository.java
  120. +12 −2 server/src/main/java/org/elasticsearch/rest/action/search/RestMultiSearchAction.java
  121. +2 −2 server/src/main/java/org/elasticsearch/search/DocValueFormat.java
  122. +1 −1 server/src/main/java/org/elasticsearch/transport/BytesTransportRequest.java
  123. +12 −2 server/src/main/java/org/elasticsearch/transport/OutboundHandler.java
  124. +56 −235 server/src/test/java/org/apache/lucene/search/XCombinedFieldQueryTests.java
  125. +74 −0 server/src/test/java/org/elasticsearch/action/fieldcaps/FieldCapabilitiesResponseTests.java
  126. +5 −5 server/src/test/java/org/elasticsearch/action/search/MultiSearchRequestTests.java
  127. +18 −0 server/src/test/java/org/elasticsearch/cluster/node/DiscoveryNodeFiltersTests.java
  128. +29 −2 server/src/test/java/org/elasticsearch/index/query/ScriptScoreQueryBuilderTests.java
  129. +56 −10 server/src/test/java/org/elasticsearch/index/query/functionscore/FunctionScoreQueryBuilderTests.java
  130. +100 −0 server/src/test/java/org/elasticsearch/search/DocValueFormatTests.java
  131. +14 −10 server/src/test/java/org/elasticsearch/search/sort/FieldSortBuilderTests.java
  132. +2 −0 x-pack/docs/en/rest-api/security.asciidoc
  133. +72 −0 x-pack/docs/en/rest-api/security/get-user-privileges.asciidoc
  134. +1 −2 x-pack/docs/en/rest-api/security/has-privileges.asciidoc
  135. +58 −40 x-pack/docs/en/security/authentication/service-accounts.asciidoc
  136. +1 −1 x-pack/docs/en/watcher/transform/search.asciidoc
  137. +1 −0 x-pack/plugin/autoscaling/build.gradle
  138. +6 −5 ...lClusterTest/java/org/elasticsearch/xpack/autoscaling/AbstractFrozenAutoscalingIntegTestCase.java
  139. +146 −0 ...ernalClusterTest/java/org/elasticsearch/xpack/autoscaling/existence/FrozenExistenceDeciderIT.java
  140. +30 −0 ...rch/xpack/autoscaling/existence/LocalStateAutoscalingAndSearchableSnapshotsAndIndexLifecycle.java
  141. +4 −1 ...rc/internalClusterTest/java/org/elasticsearch/xpack/autoscaling/shards/FrozenShardsDeciderIT.java
  142. +4 −1 .../internalClusterTest/java/org/elasticsearch/xpack/autoscaling/storage/FrozenStorageDeciderIT.java
  143. +16 −2 ...g/src/internalClusterTest/java/org/elasticsearch/xpack/autoscaling/storage/ReactiveStorageIT.java
  144. +8 −1 x-pack/plugin/autoscaling/src/main/java/org/elasticsearch/xpack/autoscaling/Autoscaling.java
  145. +131 −0 ...ng/src/main/java/org/elasticsearch/xpack/autoscaling/existence/FrozenExistenceDeciderService.java
  146. +73 −3 ...ling/src/main/java/org/elasticsearch/xpack/autoscaling/storage/ReactiveStorageDeciderService.java
  147. +84 −0 ...c/test/java/org/elasticsearch/xpack/autoscaling/existence/FrozenExistenceDeciderServiceTests.java
  148. +40 −0 ...va/org/elasticsearch/xpack/autoscaling/existence/FrozenExistenceReasonWireSerializationTests.java
  149. +219 −1 ...src/test/java/org/elasticsearch/xpack/autoscaling/storage/ReactiveStorageDeciderServiceTests.java
  150. +12 −3 x-pack/plugin/ccr/qa/multi-cluster/src/test/java/org/elasticsearch/xpack/ccr/AutoFollowIT.java
  151. +5 −2 x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/async/AsyncTaskIndexService.java
  152. +16 −0 x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/ilm/LifecycleAction.java
  153. +11 −0 x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/ilm/LifecycleExecutionState.java
  154. +4 −2 x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/ilm/LifecyclePolicy.java
  155. +17 −4 x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/ilm/MountSnapshotStep.java
  156. +17 −6 x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/ilm/SearchableSnapshotAction.java
  157. +62 −0 x-pack/plugin/core/src/main/java/org/elasticsearch/xpack/core/ilm/WaitForDataTierStep.java
  158. +18 −2 ...rc/main/java/org/elasticsearch/xpack/core/searchablesnapshots/MountSearchableSnapshotRequest.java
  159. +1 −1 ...gin/core/src/main/java/org/elasticsearch/xpack/core/transform/action/GetTransformStatsAction.java
  160. +3 −3 x-pack/plugin/core/src/test/java/org/elasticsearch/xpack/core/ilm/LifecyclePolicyTests.java
  161. +20 −4 x-pack/plugin/core/src/test/java/org/elasticsearch/xpack/core/ilm/SearchableSnapshotActionTests.java
  162. +100 −0 x-pack/plugin/core/src/test/java/org/elasticsearch/xpack/core/ilm/WaitForDataTierStepTests.java
  163. +5 −4 .../test/java/org/elasticsearch/xpack/core/transform/action/GetTransformStatsActionRequestTests.java
  164. +6 −1 x-pack/plugin/ilm/src/main/java/org/elasticsearch/xpack/ilm/IndexLifecycle.java
  165. +3 −2 x-pack/plugin/ilm/src/main/java/org/elasticsearch/xpack/ilm/IndexLifecycleService.java
  166. +8 −5 x-pack/plugin/ilm/src/main/java/org/elasticsearch/xpack/ilm/PolicyStepsRegistry.java
  167. +11 −9 x-pack/plugin/ilm/src/main/java/org/elasticsearch/xpack/ilm/action/TransportPutLifecycleAction.java
  168. +1 −1 x-pack/plugin/ilm/src/test/java/org/elasticsearch/xpack/ilm/ExecuteStepsUpdateTaskTests.java
  169. +6 −6 x-pack/plugin/ilm/src/test/java/org/elasticsearch/xpack/ilm/IndexLifecycleRunnerTests.java
  170. +2 −2 x-pack/plugin/ilm/src/test/java/org/elasticsearch/xpack/ilm/IndexLifecycleServiceTests.java
  171. +3 −3 x-pack/plugin/ilm/src/test/java/org/elasticsearch/xpack/ilm/MoveToNextStepUpdateTaskTests.java
  172. +14 −14 x-pack/plugin/ilm/src/test/java/org/elasticsearch/xpack/ilm/PolicyStepsRegistryTests.java
  173. +15 −15 ...plugin/ilm/src/test/java/org/elasticsearch/xpack/ilm/action/TransportPutLifecycleActionTests.java
  174. +20 −7 ...-multi-node-tests/src/javaRestTest/java/org/elasticsearch/xpack/ml/integration/AutoscalingIT.java
  175. +50 −7 ...k/plugin/ml/src/main/java/org/elasticsearch/xpack/ml/autoscaling/MlAutoscalingDeciderService.java
  176. +11 −4 x-pack/plugin/ml/src/main/java/org/elasticsearch/xpack/ml/autoscaling/NativeMemoryCapacity.java
  177. +22 −29 x-pack/plugin/ml/src/main/java/org/elasticsearch/xpack/ml/utils/NativeMemoryCalculator.java
  178. +90 −7 ...gin/ml/src/test/java/org/elasticsearch/xpack/ml/autoscaling/MlAutoscalingDeciderServiceTests.java
  179. +4 −4 x-pack/plugin/ml/src/test/java/org/elasticsearch/xpack/ml/autoscaling/NativeMemoryCapacityTests.java
  180. +63 −23 x-pack/plugin/ml/src/test/java/org/elasticsearch/xpack/ml/utils/NativeMemoryCalculatorTests.java
  181. +3 −1 ...erTest/java/org/elasticsearch/xpack/searchablesnapshots/BaseSearchableSnapshotsIntegTestCase.java
  182. +1 −2 ...terTest/java/org/elasticsearch/xpack/searchablesnapshots/FrozenSearchableSnapshotsIntegTests.java
  183. +1 −2 ...alClusterTest/java/org/elasticsearch/xpack/searchablesnapshots/SearchableSnapshotsIntegTests.java
  184. +0 −17 ...able-snapshots/src/main/java/org/elasticsearch/xpack/searchablesnapshots/SearchableSnapshots.java
  185. +2 −2 ...va/org/elasticsearch/xpack/searchablesnapshots/action/TransportMountSearchableSnapshotAction.java
  186. +8 −8 ...ts/src/main/java/org/elasticsearch/xpack/searchablesnapshots/cache/shared/FrozenCacheService.java
  187. +15 −4 .../src/main/java/org/elasticsearch/xpack/searchablesnapshots/store/SearchableSnapshotDirectory.java
  188. +12 −16 ...rc/test/java/org/elasticsearch/xpack/searchablesnapshots/AbstractSearchableSnapshotsTestCase.java
  189. +0 −12 x-pack/plugin/sql/qa/jdbc/src/main/java/org/elasticsearch/xpack/sql/qa/jdbc/JdbcErrorsTestCase.java
  190. +0 −2 x-pack/plugin/sql/qa/server/src/main/java/org/elasticsearch/xpack/sql/qa/ErrorsTestCase.java
  191. +0 −11 x-pack/plugin/sql/qa/server/src/main/java/org/elasticsearch/xpack/sql/qa/cli/ErrorsTestCase.java
  192. +9 −0 x-pack/plugin/sql/qa/server/src/main/java/org/elasticsearch/xpack/sql/qa/jdbc/DataLoader.java
  193. +4 −1 x-pack/plugin/sql/qa/server/src/main/java/org/elasticsearch/xpack/sql/qa/jdbc/SqlSpecTestCase.java
  194. +0 −10 x-pack/plugin/sql/qa/server/src/main/java/org/elasticsearch/xpack/sql/qa/rest/RestSqlTestCase.java
  195. +21 −4 x-pack/plugin/sql/qa/server/src/main/resources/command.csv-spec
  196. +28 −0 x-pack/plugin/sql/qa/server/src/main/resources/empty-mapping.csv-spec
  197. +22 −0 x-pack/plugin/sql/qa/server/src/main/resources/empty-mapping.sql-spec
  198. +12 −0 x-pack/plugin/sql/qa/server/src/main/resources/select.sql-spec
  199. +5 −0 x-pack/plugin/sql/qa/server/src/main/resources/setup_empty_mapping.sql
  200. +3 −2 x-pack/plugin/sql/qa/server/src/main/resources/setup_test_emp.sql
  201. +10 −9 x-pack/plugin/sql/qa/server/src/main/resources/slow/frozen.csv-spec
  202. +7 −6 x-pack/plugin/sql/src/main/java/org/elasticsearch/xpack/sql/analysis/analyzer/Analyzer.java
  203. +30 −27 x-pack/plugin/sql/src/main/java/org/elasticsearch/xpack/sql/optimizer/Optimizer.java
  204. +3 −10 x-pack/plugin/sql/src/main/java/org/elasticsearch/xpack/sql/plan/logical/LocalRelation.java
  205. +3 −1 x-pack/plugin/sql/src/main/java/org/elasticsearch/xpack/sql/querydsl/container/QueryContainer.java
  206. +12 −0 ...k/plugin/sql/src/test/java/org/elasticsearch/xpack/sql/analysis/analyzer/FieldAttributeTests.java
  207. +49 −0 x-pack/plugin/sql/src/test/java/org/elasticsearch/xpack/sql/optimizer/OptimizerTests.java
  208. +4 −8 ...plugin/src/yamlRestTest/resources/rest-api-spec/test/data_stream/10_data_stream_resolvability.yml
1 change: 1 addition & 0 deletions .ci/bwcVersions
Original file line number Diff line number Diff line change
Expand Up @@ -83,3 +83,4 @@ BWC_VERSION:
- "7.12.1"
- "7.13.0"
- "7.13.1"
- "7.13.2"
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,6 @@
- debian-8-packaging
- debian-9-packaging
- debian-10-packaging
- fedora-32-packaging
- opensuse-15-1-packaging
- oraclelinux-6-packaging
- oraclelinux-7-packaging
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -27,5 +27,5 @@
mkdir %USERPROFILE%\.gradle\init.d
copy .ci\init.gradle %USERPROFILE%\.gradle\init.d\
(
echo powershell.exe .\.ci\os.ps1 ^|^| exit /b 1
echo powershell.exe .\.ci\scripts\packaging-test.ps1 ^|^| exit /b 1
) | java -jar "C:\Program Files\infra\bin\runbld" --redirect-stderr -
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,6 @@
- "debian-8&&immutable"
- "debian-9&&immutable"
- "debian-10&&immutable"
- "fedora-32&&immutable"
- "opensuse-15-1&&immutable"
- "oraclelinux-6&&immutable"
- "oraclelinux-7&&immutable"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,6 @@
- centos-8-packaging
- debian-9-packaging
- debian-10-packaging
- fedora-32-packaging
- opensuse-15-1-packaging
- oraclelinux-7-packaging
- oraclelinux-8-packaging
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -51,5 +51,5 @@
mkdir %USERPROFILE%\.gradle\init.d
copy .ci\init.gradle %USERPROFILE%\.gradle\init.d\
(
echo powershell.exe .\.ci\os.ps1 -GradleTasks destructiveDistroTest.%PACKAGING_TASK% ^|^| exit /b 1
echo powershell.exe .\.ci\scripts\packaging-test.ps1 -GradleTasks destructiveDistroTest.%PACKAGING_TASK% ^|^| exit /b 1
) | java -jar "C:\Program Files\infra\bin\runbld" --redirect-stderr -
Original file line number Diff line number Diff line change
Expand Up @@ -54,5 +54,5 @@
mkdir %USERPROFILE%\.gradle\init.d
copy .ci\init.gradle %USERPROFILE%\.gradle\init.d\
(
echo powershell.exe .\.ci\os.ps1 -GradleTasks destructiveDistroTest.%PACKAGING_TASK% ^|^| exit /b 1
echo powershell.exe .\.ci\scripts\packaging-test.ps1 -GradleTasks destructiveDistroTest.%PACKAGING_TASK% ^|^| exit /b 1
) | java -jar "C:\Program Files\infra\bin\runbld" --redirect-stderr -
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@
excluded-regions:
- ^docs/.*
white-list-labels:
- ':Security/FIPS'
- 'Team:Security'
black-list-labels:
- '>test-mute'
builders:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@
excluded-regions:
- ^docs/.*
white-list-labels:
- ':Security/FIPS'
- 'Team:Security'
black-list-labels:
- '>test-mute'
builders:
Expand Down
1 change: 1 addition & 0 deletions .ci/scripts/packaging-test.ps1
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ If (-NOT ([Security.Principal.WindowsPrincipal] [Security.Principal.WindowsIdent
$AppProps = ConvertFrom-StringData (Get-Content .ci/java-versions.properties -raw)
$env:ES_BUILD_JAVA=$AppProps.ES_BUILD_JAVA
$env:ES_RUNTIME_JAVA=$AppProps.ES_RUNTIME_JAVA
$env:JAVA_TOOL_OPTIONS=''

$ErrorActionPreference="Stop"
$gradleInit = "C:\Users\$env:username\.gradle\init.d\"
Expand Down
2 changes: 1 addition & 1 deletion buildSrc/version.properties
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
elasticsearch = 7.13.2
elasticsearch = 7.13.3
lucene = 8.8.2

bundled_jdk_vendor = adoptopenjdk
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,7 @@
import org.elasticsearch.ingest.Pipeline;
import org.elasticsearch.search.SearchHit;
import org.elasticsearch.search.SearchModule;
import org.elasticsearch.tasks.RawTaskStatus;
import org.elasticsearch.tasks.TaskId;
import org.elasticsearch.test.rest.ESRestTestCase;
import org.junit.AfterClass;
Expand Down Expand Up @@ -324,7 +325,10 @@ protected static TaskId findTaskToRethrottle(String actionName, String descripti
}
TaskGroup taskGroup = taskGroups.get(0);
assertThat(taskGroup.getChildTasks(), empty());
return taskGroup.getTaskInfo().getTaskId();
// check that the task initialized enough that it can rethrottle too.
if (((RawTaskStatus) taskGroup.getTaskInfo().getStatus()).toMap().containsKey("batches")) {
return taskGroup.getTaskInfo().getTaskId();
}
} while (System.nanoTime() - start < TimeUnit.SECONDS.toNanos(10));
throw new AssertionError("Couldn't find tasks to rethrottle. Here are the running tasks " +
highLevelClient().tasks().list(request, RequestOptions.DEFAULT));
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -263,6 +263,8 @@ public void onFailure(Exception e) {
float requestsPerSecond = 1000f;
ListTasksResponse response = execute(new RethrottleRequest(taskIdToRethrottle, requestsPerSecond),
highLevelClient()::deleteByQueryRethrottle, highLevelClient()::deleteByQueryRethrottleAsync);
assertThat(response.getTaskFailures(), empty());
assertThat(response.getNodeFailures(), empty());
assertThat(response.getTasks(), hasSize(1));
assertEquals(taskIdToRethrottle, response.getTasks().get(0).getTaskId());
assertThat(response.getTasks().get(0).getStatus(), instanceOf(RawTaskStatus.class));
Expand Down
2 changes: 1 addition & 1 deletion distribution/build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ tasks.register("generateDependenciesReport", ConcatFilesTask) {
'8',
'https://catalog.redhat.com/software/containers/ubi8/ubi-minimal/5c359a62bed8bd75a2c3fba8',
'Custom;https://www.redhat.com/licenses/EULA_Red_Hat_Universal_Base_Image_English_20190422.pdf',
'https://oss-dependencies.elastic.co/redhat/ubi/ubi-minimal-8-source.tar.gz'
'https://oss-dependencies.elastic.co/red-hat-universal-base-image-minimal/8/ubi-minimal-8-source.tar.gz'
]
additionalLines << rhelUbiFields.join(',')
}
Expand Down
6 changes: 6 additions & 0 deletions docs/community-clients/index.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,7 @@ a number of clients that have been contributed by the community for various lang
* <<rust>>
* <<scala>>
* <<smalltalk>>
* <<swift>>
* <<vertx>>

[[b4j]]
Expand Down Expand Up @@ -236,6 +237,11 @@ client].

* https://github.com/newapplesho/elasticsearch-smalltalk[elasticsearch-smalltalk]:
Pharo Smalltalk client for Elasticsearch.

[[swift]]
== Swift
* https://github.com/brokenhandsio/elasticsearch-nio-client[Elasticsearch NIO Client]: a library for
working with Elasticsearch in Swift, built on top of SwiftNIO and Swift Package Manager.

[[vertx]]
== Vert.x
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,9 @@
[id="{upid}-{api}"]
=== Get Builtin Privileges API

Retrieves the list of cluster privileges and index privileges that are
available in this version of {es}.

include::../execution-no-req.asciidoc[]

[id="{upid}-{api}-response"]
Expand Down
6 changes: 4 additions & 2 deletions docs/java-rest/high-level/security/get-privileges.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -6,12 +6,14 @@
--
[role="xpack"]
[id="{upid}-{api}"]
=== Get Privileges API
=== Get Application Privileges API

Retrieves application privileges.

[id="{upid}-{api}-request"]
==== Get Privileges Request

The +{request}+ supports getting privilege(s) for all or for specific applications.
The +{request}+ supports getting privileges for all or for specific applications.

===== Specific privilege of a specific application

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@
[id="{upid}-{api}"]
=== Get User Privileges API

Retrieves security privileges for the logged in user.

include::../execution-no-req.asciidoc[]

[id="{upid}-{api}-response"]
Expand Down
2 changes: 2 additions & 0 deletions docs/java-rest/high-level/security/has-privileges.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,8 @@
[id="{upid}-{api}"]
=== Has Privileges API

Determines whether the logged in user has a specified list of privileges.

[id="{upid}-{api}-request"]
==== Has Privileges Request
The +{request}+ supports checking for any or all of the following privilege types:
Expand Down
4 changes: 3 additions & 1 deletion docs/painless/painless-guide/index.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -8,4 +8,6 @@ include::painless-method-dispatch.asciidoc[]

include::painless-debugging.asciidoc[]

include::painless-execute-script.asciidoc[]
include::painless-execute-script.asciidoc[]

include::painless-ingest.asciidoc[]
98 changes: 98 additions & 0 deletions docs/painless/painless-guide/painless-ingest.asciidoc
Original file line number Diff line number Diff line change
@@ -0,0 +1,98 @@
[[painless-ingest]]
=== Using ingest processors in Painless

Some {ref}/processors.html[ingest processors] expose behavior through Painless
methods that can be called in Painless scripts that execute in ingest pipelines.

==== Method usage

All ingest methods available in Painless are scoped to the `Processors`
namespace. For example:

[source,console]
----
POST /_ingest/pipeline/_simulate?verbose
{
"pipeline": {
"processors": [
{
"script": {
"lang": "painless",
"source": """
long bytes = Processors.bytes(ctx.size);
ctx.size_in_bytes = bytes;
"""
}
}
]
},
"docs": [
{
"_source": {
"size": "1kb"
}
}
]
}
----

==== Ingest methods reference

===== Byte conversion
Use the {ref}/bytes-processor.html[bytes processor] to return the number of
bytes in the human-readable byte value supplied in the `value` parameter.

[source,Painless]
----
long bytes(String value);
----

===== Lowercase conversion
Use the {ref}/lowercase-processor.html[lowercase processor] to convert the
supplied string in the `value` parameter to its lowercase equivalent.

[source,Painless]
----
String lowercase(String value);
----

===== Uppercase conversion
Use the {ref}/uppercase-processor.html[uppercase processor] to convert the
supplied string in the `value` parameter to its uppercase equivalent.

[source,Painless]
----
String uppercase(String value);
----

===== JSON parsing
Use the {ref}/json-processor.html[JSON processor] to convert JSON strings to structured
JSON objects. The first `json` method accepts a map and a key. The processor converts
the JSON string in the map as specified by the `key` parameter to structured JSON content.
That content is added directly to the `map` object.

The second `json` method accepts a JSON string in the `value` parameter and
returns a structured JSON object.

[source,Painless]
----
void json(Map<String, Object> map, String key);
Object json(Object value);
----

You can then add this object to the document through the context object:

[source,Painless]
----
Object json = Processors.json(ctx.inputJsonString);
ctx.structuredJson = json;
----

===== URL decoding
Use the {ref}/urldecode-processor.html[URL decode processor] to URL-decode the string
supplied in the `value` parameter.

[source,Painless]
----
String urlDecode(String value);
----
6 changes: 2 additions & 4 deletions docs/reference/aggregations/bucket.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -13,10 +13,8 @@ aggregated for the buckets created by their "parent" bucket aggregation.
There are different bucket aggregators, each with a different "bucketing" strategy. Some define a single bucket, some
define fixed number of multiple buckets, and others dynamically create the buckets during the aggregation process.

NOTE: The maximum number of buckets allowed in a single response is limited by a
dynamic cluster setting named
<<search-settings-max-buckets,`search.max_buckets`>>. It defaults to 65,536.
Requests that try to return more than the limit will fail with an exception.
NOTE: The <<search-settings-max-buckets,`search.max_buckets`>> cluster setting
limits the number of buckets allowed in a single response.

include::bucket/adjacency-matrix-aggregation.asciidoc[]

Expand Down
15 changes: 11 additions & 4 deletions docs/reference/aggregations/bucket/terms-aggregation.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -60,16 +60,13 @@ GET /_search
{
"aggs": {
"genres": {
"terms": { "field": "genre" } <1>
"terms": { "field": "genre" }
}
}
}
--------------------------------------------------
// TEST[s/_search/_search\?filter_path=aggregations/]

<1> `terms` aggregation should be a field of type `keyword` or any other data type suitable for bucket aggregations. In order to use it with `text` you will need to enable
<<fielddata, fielddata>>.

Response:

[source,console-result]
Expand Down Expand Up @@ -107,6 +104,16 @@ Response:
By default, the `terms` aggregation will return the buckets for the top ten terms ordered by the `doc_count`. One can
change this default behaviour by setting the `size` parameter.

[[search-aggregations-bucket-terms-aggregation-types]]
The `field` can be <<keyword>>, <<number>>, <<ip, `ip`>>, <<boolean, `boolean`>>,
or <<binary, `binary`>>.

NOTE: By default, you cannot run a `terms` aggregation on a `text` field. Use a
`keyword` <<multi-fields,sub-field>> instead. Alternatively, you can enable
<<fielddata,`fielddata`>> on the `text` field to create buckets for the field's
<<analysis,analyzed>> terms. Enabling `fielddata` can significantly increase
memory usage.

[[search-aggregations-bucket-terms-aggregation-size]]
==== Size

Expand Down
10 changes: 8 additions & 2 deletions docs/reference/api-conventions.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,13 @@

The {es} REST APIs are exposed over HTTP.

The conventions listed in this chapter can be applied throughout the REST
API, unless otherwise specified.
A number of {es} GET APIs--most notably the search API--support a request body.
While the GET action makes sense in the context of retrieving information,
GET requests with a body are not supported by all HTTP libraries.
All {es} GET APIs that require a body can also be submitted as POST requests.
Alternatively, you can pass the request body as the
<<api-request-body-query-string, `source` query string parameter>>
when using GET.

* <<multi-index>>
* <<date-math-index-names>>
Expand Down Expand Up @@ -672,6 +677,7 @@ The response looks like:
// TESTRESPONSE[s/"stack_trace": "java.lang.Number.+\.\.\."/"stack_trace": $body.error.caused_by.stack_trace/]

[discrete]
[[api-request-body-query-string]]
==== Request body in query string

For libraries that don't accept a request body for non-POST requests,
Expand Down
5 changes: 5 additions & 0 deletions docs/reference/autoscaling/autoscaling-deciders.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,10 @@ Estimates required storage capacity as a percentage of the total data set of
partially mounted indices.
Available for policies governing frozen data nodes.

<<autoscaling-frozen-existence-decider,Frozen existence decider>>::
Estimates a minimum require frozen memory and storage capacity when any index is
in the frozen <<index-lifecycle-management,ILM>> phase.

<<autoscaling-machine-learning-decider,Machine learning decider>>::
Estimates required memory capacity based on machine learning jobs.
Available for policies governing machine learning nodes.
Expand All @@ -31,5 +35,6 @@ include::deciders/reactive-storage-decider.asciidoc[]
include::deciders/proactive-storage-decider.asciidoc[]
include::deciders/frozen-shards-decider.asciidoc[]
include::deciders/frozen-storage-decider.asciidoc[]
include::deciders/frozen-existence-decider.asciidoc[]
include::deciders/machine-learning-decider.asciidoc[]
include::deciders/fixed-decider.asciidoc[]
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
[role="xpack"]
[[autoscaling-frozen-existence-decider]]
=== Frozen existence decider

The frozen existence decider (`frozen_existence`) ensures that once the first
index enters the frozen ILM phase, the frozen tier is scaled into existence.

The frozen existence decider is enabled for all policies governing frozen data
nodes and has no configuration options.
Loading