Druid 30.0.0 release notes

docs/release-info/upgrade-notes.md

@@ -26,6 +26,91 @@ The upgrade notes assume that you are upgrading from the Druid version that imme
 
 For the full release notes for a specific version, see the [releases page](https://github.com/apache/druid/releases).
 
+## 30.0.0
+
+### Upgrade notes
+
+#### Azure input source schema
+
+The `azure` schema for ingesting from Azure has been deprecated. Use the new `azureStorage` schema instead. It provides additional functionality. For more information, see [Azure input source schema](#azure-input-source-schema).
+
+Additionally, the new config `storageAccountEndpointSuffix` lets you configure the endpoint suffix to use so that you can override the default and connect to other endpoints, such as Azure Government.
+
+[#15630](https://github.com/apache/druid/pull/15630) [#16016](https://github.com/apache/druid/pull/16016)
+
+#### Append JsonPath function
+
+The `append` function for JsonPath for ORC format now fails with an exception. Previously, it would run but not append anything.
+
+[#15772](https://github.com/apache/druid/pull/15772)
+
+#### Kinesis ingestion tuning
+
+The following properties have been deprecated as part of simplifying the memory tuning for Kinesis ingestion:
+
+- `recordBufferSize`,  use `recordBufferSizeBytes` instead
+- `maxRecordsPerPoll`, use `maxBytesPerPoll` instead
+
+[#15360](https://github.com/apache/druid/pull/15360)
+
+#### Improved Supervisor rolling restarts
+
+The `stopTaskCount` config now prioritizes stopping older tasks first. As part of this change, you must also explicitly set a value for `stopTaskCount`. It no longer defaults to the same value as `taskCount`.
+
+[#15859](https://github.com/apache/druid/pull/15859)
+
+#### Changes to Coordinator default values
+
+The following are the changes to the default values for the Coordinator service:
+
+* The default value for `druid.coordinator.kill.period` (if unspecified) has changed from `P1D` to the value of `druid.coordinator.period.indexingPeriod`. Operators can choose to override `druid.coordinator.kill.period` and that takes precedence over the default behavior.
+* The default value for the dynamic configuration property `killTaskSlotRatio` has been updated from `1.0` to `0.1`. This ensures that kill tasks take up only one task slot by default instead of consuming all available task slots.
+
+[#16247](https://github.com/apache/druid/pull/16247)
+
+#### `GoogleTaskLogs` upload buffer size
+
+Changed the upload buffer size in `GoogleTaskLogs` to 1 MB instead of 15 MB to allow more uploads in parallel and prevent the MiddleManager service from running out of memory.
+
+[#16236](https://github.com/apache/druid/pull/16236)
+
+### Incompatible changes
+
+#### Changes to `targetDataSource` in EXPLAIN queries
+
+Druid 30.0.0 includes a breaking change that restores the behavior for `targetDataSource` to its 28.0.0 and earlier state, different from Druid 29.0.0 and only 29.0.0. In 29.0.0, `targetDataSource` returns a JSON object that includes the datasource name. In all other versions, `targetDataSource` returns a string containing the name of the datasource.
+
+If you're upgrading from any version other than 29.0.0, there is no change in behavior.
+
+If you are upgrading from 29.0.0, this is an incompatible change.
+
+[#16004](https://github.com/apache/druid/pull/16004)
+
+#### Removed ZooKeeper-based segment loading
+
+ZooKeeper-based segment loading is being removed as it is known to have issues and has been deprecated for several releases.
+The recent improvements made to the Druid Coordinator are also known to work much better with HTTP-based segment loading.
+
+[#15705](https://github.com/apache/druid/pull/15705)
+
+#### Removed Coordinator configs
+
+Removed the following Coordinator configs:
+
+* `druid.coordinator.load.timeout`: Not needed as the default value of this parameter (15 minutes) is known to work well for all clusters.
+* `druid.coordinator.loadqueuepeon.type`: Not needed as this value is always `http`.
+* `druid.coordinator.curator.loadqueuepeon.numCallbackThreads`: Not needed as ZooKeeper(curator)-based segment loading isn't an option anymore.
+
+Auto-cleanup of compaction configs of inactive datasources is now enabled by default.
+
+[#15705](https://github.com/apache/druid/pull/15705)
+
+#### Changed `useMaxMemoryEstimates` for Hadoop jobs
+
+The default value of the `useMaxMemoryEstimates` parameter for Hadoop jobs is now `false`.
+
+[#16280](https://github.com/apache/druid/pull/16280)
+
 ## 29.0.1
 
 ### Incompatible changes

website/.spelling

@@ -39,6 +39,7 @@ Actian
 Authorizer
 Avatica
 Avro
+Axios
 Azul
 AzureDNSZone
 BCP
@@ -99,6 +100,7 @@ Elasticsearch
 Enums
 FirehoseFactory
 FIRST_VALUE
+FIPS
 FlattenSpec
 Float.NEGATIVE_INFINITY
 Float.NEGATIVE_INFINITY.
@@ -191,13 +193,16 @@ Murmur3
 MVCC
 MV_TO_ARRAY
 NFS
+NPE
 OCF
 OIDC
 OLAP
+OOM
 OOMs
 OpenJDK
 OpenLDAP
 OpenTSDB
+ORC
 OutputStream
 ParAccel
 ParseSpec
@@ -248,6 +253,7 @@ uris
 UTF-16
 UTF-8
 UTF8
+UX
 XMLs
 ZK
 ZSTD
@@ -393,6 +399,8 @@ lookback
 lookups
 mapreduce
 masse
+materializations
+materialization
 maxBytes
 maxNumericInFilters
 maxNumFiles
@@ -417,6 +425,7 @@ namespaced
 namespaces
 natively
 netflow
+Netty
 nondescriptive
 nonfinalized
 non-null
@@ -526,6 +535,8 @@ stringDictionaryEncoding
 stringified
 sub-conditions
 subarray
+subfilters
+subfilter
 subnet
 subqueries
 subquery
@@ -2189,6 +2200,7 @@ regionName
 json
 metastore
 UserGroupInformation
+CVEs
 CVE-2019-17571
 CVE-2019-12399
 CVE-2018-17196