Skip to content

3.10.0

Latest

Choose a tag to compare

@github-actions github-actions released this 18 Nov 01:52
· 43 commits to main since this release
Immutable release. Only release title and notes can be modified.
b9f0924

Version 3.10.0 Release Notes

Compatible with OpenSearch and OpenSearch Dashboards version 3.10.0

Breaking Changes

  • Remove the experimental Views feature (#23263)
  • Remove MacOS/x64 archive distributions (#23160)

Features

  • Add RestoreListenerPlugin interface, called after a snapshot restore finishes (#23295)
  • Add limit parameter to _cat APIs for top-N row retrieval (#23439)
  • Add GET /_cluster/settings/_describe API to report whether cluster settings are dynamic, with defaults, validation bounds, and descriptions (#23360), (#23400), (#23412), (#23456), (#23474)
  • Add cluster setting to enable/disable request and query cache cluster-wide (#23383)
  • Add per-node request throttling to workload management (#22869)
  • Add cluster-wide shared limit for workload management request throttling (#23264)
  • Add administrative REST route metadata for authorization plugins (#22979)
  • Expose registered action names to plugins via DynamicActionRegistry (#23226)
  • Add RoaringOrdinalsCollector for memory-efficient cardinality aggregation under multi-bucket parents (#21970)
  • Add object store source for pull-based ingestion (#23339)
  • Add pluggable format seams for nested and flat_object field types (#23121)
  • Compose additional index reader wrappers beneath the setReaderWrapper slot (#23312)
  • Expose caller TLS session on Arrow Flight server channels (#23465)
  • Extend getFieldFilter() contract and make it available via FieldFilterProvider and PluginComponentRegistry (#23292)
  • Enable full-copy snapshots for pluggable data format shards (#23155)
  • Decouple shard snapshots from Lucene IndexCommit using CatalogSnapshot (#22930)
  • Multi-part parallel download of large segment files from remote store (#23016)
  • Support pre-materialized get results in _explain (#23110)

Enhancements

  • Allow limiting total S3 API call time via s3.client.<name>.api_call_timeout (#23185)
  • Make telemetry-otel histogram aggregation configurable (#23178)
  • Make telemetry-otel service.name configurable via telemetry.otel.service.name (#23114)
  • Skip IndicesStats fan-out in _cat/shards when only routing columns are requested (#23435)
  • Answer cluster settings describe on the receiving node instead of forwarding to cluster manager (#23426)
  • Skip the token stream for the default keyword normalizer to reduce indexing CPU overhead (#23306)
  • Use thread-local JSON recycler pool to fix indexing throughput collapse under concurrency (#23150)
  • Restore search performance with cancellation enabled by preserving Lucene bulk postings operations (#23117)
  • Forward bulk visit methods in ExitableIntersectVisitor for faster point queries with cancellation (#23201)
  • Avoid blocking keyed cache invalidation when a load is in flight (#22761)
  • Remove redundant synchronized from ShardCoreKeyMap#getShardId to reduce search contention (#22803)
  • Block ptrace and process memory access syscalls in the system call filter (#23491)
  • Bound min_hash filter parameters to prevent OOM (#23362)
  • Mask secret values in reported JVM arguments (#23356)
  • Ignore excluded nodes in zone awareness count so shards can drain off fully excluded zones (#22967)
  • Push down ordered list limits in Azure blob listings (#23237)
  • Add conditional blob writes for Azure Blob Storage (#23265)
  • Configure Azure SDK read and write transfer options (#23239)
  • Propagate Azure blob existence failures instead of silently returning false (#23266)
  • Propagate metadata on synchronous remote translog blob uploads (#23274)
  • Skip re-downloading remote translog generations already present locally (#23146)
  • Batch primary translog appends to amortize per-operation overhead for remote store indices (#23224)
  • Hydrate from the remote store outside the engine open lock to avoid blocking shard close (#23203)
  • Remove deleted index data left behind by a held shard lock (#23393)
  • Resolve primary operation policy on promotion for document replication (#23175)
  • Add _msearch/template sub-request count limit and circuit-breaking logic to prevent OOM (#23320)
  • Let a second ./gradlew run add nodes to the cluster the first one started (#23221)
  • Reject invalid values for _cat limit parameter (#23453)
  • Count bulk visits in approximate range early termination (#23470)
  • Describe cluster settings by prefix with wildcard support (#23474)

Bug Fixes

  • Fix RoutingMissingException NPE when indexing with generated ID on routing-required index (#23096)
  • Fix UnsupportedOperationException on nested sort during early termination (#22534)
  • Fix addEmptyBuckets from creating too many buckets when given large extended bounds (#17718)
  • Fix bulk indexing request corruption on shard backpressure rejection (#20727)
  • Fix duplicate elements left by CollectionUtils.sortAndDedup (#22445)
  • Accept zero term statistics in term vectors responses for terms not in the index (#23467)
  • Fix stuck primaryReplicaResyncInProgress flag blocking primary relocation (#23075)
  • Fix refreshed checkpoint stuck behind visible ops (#23195)
  • Fix segment replication lag reported as Unix epoch when checkpoint lacks created timestamp (#23311)
  • Fix shard indexing pressure limit never growing after idle (#23471)
  • Exclude recovering replicas from segment replication lag metrics (#23123)
  • Fix tracer heap leak: TraceableTcpTransportChannel retains a close listener per request (#23119)
  • Fix translog UUID mismatch on pull-based ingestion index restart (#23090)
  • Fix monitor mode workload group rejections (#22654)
  • Fix phantom WLM rejections and stats for coordinator and shard search tasks (#22839)
  • Fix workload group cancel interval being ignored on the coordinating node (#23449)
  • Fix WarmDiskThresholdDecider canMove checks to prevent unnecessary calculations (#23176)
  • Reject joins of nodes the cluster manager is no longer connected to (#23296)
  • Reject out-of-range cluster setting updates at validation time instead of at apply time (#22655)
  • Fix data loss and stalls in segments_only remote store mode (#23288)
  • Fail shard when a snapshot hits a corrupt commit (#23492)
  • Fail the shard copy in the local cluster state in LocalShardStateAction for clusterless mode (#23220)
  • Decode policy codebase URLs before canonicalizing to fix symlinked paths with spaces (#23546)
  • Prevent stuck snapshot deletes and queue starvation with DELETE-based recovery (#23194)
  • Fix auto force merge continuing after warm node removal (#23079)
  • Store match_only_text fields when derived source is enabled (#23357)
  • Handle partial routing tables in shard pagination in ingestion states API (#23498)
  • Support segment replication in segments_only remote store mode (#23098)
  • Fix WLM auto-tagging failure on rule-matching nested searches (#22932)

Maintenance

  • Upgrade Lucene to 10.6.0 (#23475)
  • Upgrade Lucene to 10.5.2 (#23310)
  • Update Netty to 4.2.20 (#23489)
  • Update Netty to 4.2.19.Final (#23245)
  • Update OpenTelemetry to 1.68.0 and OpenTelemetry SemConv to 1.45.0 (#23590)
  • Update OpenTelemetry to 1.67.0 (#23309)
  • Update Apache HttpClient5 to 5.6.5 and HttpCore5 to 5.4.4 (#23335)
  • Update Reactor Netty to 1.3.8 and Project Reactor to 3.8.8 (#23417)
  • Update Bouncy Castle FIPS support libraries (#23233)
  • Update bundled JDK to 25.0.5+8 (#23407)
  • Update ASM to 9.11.1 (#23378)
  • Update Jacoco and Byte Buddy (#23115)
  • Update Mockito to 5.24.0 (#23135)
  • Align commons-compress dependency versions (#23568)
  • Remove usage of deprecated ClientTlsStrategyBuilder::setTlsDetailsFactory (#23464)