druid-0.8.3 release notes

[gianm]

This is a tracking issue for the upcoming druid-0.8.3.

Release notes:

Updating from 0.8.x

• You must set druid.selectors.coordinator.serviceName to your Coordinator's druid.service value (defaults to druid/coordinator) in common.runtime.properties of all nodes. Realtime handoff will only work if this config is properly set. (See Remove ServerView from RealtimeIndexTasks and use coordinator http endpoint for handoff information #2015)
• Instead of the normal rolling update procedure, for this release you should update your Coordinator nodes before updating the overlord. (See Remove ServerView from RealtimeIndexTasks and use coordinator http endpoint for handoff information #2015)
• Min/max aggregators are now deprecated and will be removed in Druid 0.9.0. Please use longMin, longMax, doubleMin, or doubleMax aggregators as appropriate.

New Features

• Restorable indexing tasks #1881 Restorable indexing tasks
• complex aggregator based on http://datasketches.github.io #1897, datasketches module updates #1991 complex aggregator based on http://datasketches.github.io
• Enable caching on intermediate realtime persists #1943 Enable caching on intermediate realtime persists
• Ability to skip Incremental Index during query using query context #1957 Ability to skip Incremental Index during query using query context

Improvements

• Add segment merge time as a metric #1770 Add segment merge time as a metric
• EventReceiverFirehoseMonitor #1791 EventReceiverFirehoseMonitor
• Add hashCode and equals to UniformGranularitySpec #1824 Add hashCode and equals to UniformGranularitySpec
• update server metrics and emitter version #1889 update server metrics and emitter version
• Update curator to 2.9.1 #1920 Update curator to 2.9.1
• separate ingestion and query thread pool #1929 separate ingestion and query thread pool
• optimize index merge #1960 optimize index merge
• Add datasource and taskId to metrics emitted by peons #1967 Add datasource and taskId to metrics emitted by peons
• CacheMonitor - make cache injection optional #1973 CacheMonitor - make cache injection optional
• Remove ServerView from RealtimeIndexTasks and use coordinator http endpoint for handoff information #2015 Remove ServerView from RealtimeIndexTasks and use coordinator http endpoint for handoffs
• Update mmx emitter to 0.3.6 #2045 Update mmx emitter to 0.3.6
• druid.indexer.task.restoreTasksOnRestart configuration. #2145 druid.indexer.task.restoreTasksOnRestart configuration

Bug Fixes

• Add special handler to allow logger messages during shutdown #1387 Add special handler to allow logger messages during shutdown
• Support multiple outer aggregators of same type and provide more help… #1799 Support multiple outer aggregators of same type
• Fix Race in jar upload during hadoop indexing #1815 Fix Race in jar upload during hadoop indexing
• Do not pass druid.indexer.runner.javaOpts to Peon as a property #1842 Do not pass druid.indexer.runner.javaOpts to Peon as a property
• fixing hadoop test scope dependencies in indexing-hadoop #1867 fixing hadoop test scope dependencies in indexing-hadoop
• forward cancellation request to all brokers, fixes #1802 #1888 forward cancellation request to all brokers, fixes Query cancellation is not properly forwarded by Router #1802
• RemoteTaskActionClient: Fix statusCode check. #1917 RemoteTaskActionClient: Fix statusCode check.
• DataSchema: Exclude metric names from dimension list. #1932 DataSchema: Exclude metric names from dimension list.
• ForkingTaskRunner: Log without buffering. #1935 ForkingTaskRunner: Log without buffering.
• Move Jackson Guice adapters into io.druid #1940 Move Jackson Guice adapters into io.druid
• EC2 autoscaler: avoid hitting aws filter limits #1954 EC2 autoscaler: avoid hitting aws filter limits
• Change LookupExtractionFn cache key to be unique #1985 Change LookupExtractionFn cache key to be unique
• Disable javadoc linting. #2036 Disable javadoc linting
• CacheMonitor - make cache injection optional #1973 Make cache injection optional
• Fix some problems with restoring #2141 Fix some problems with restoring
• Update bytebuffer-collections to 0.2.4 #2227 Update bytebuffer-collections to 0.2.4 (upstream bugfixes in roaring bitmaps)
• Fix loadRule when one of the tiers had no available servers #2240 Fix loadRule when one of the tiers had no available servers
• fix bug for thetaSketch metric not working with select queries #2207 Fix bug for thetaSketch metric not working with select queries
• Fix loss in segment announcements when segments do not fit in zNode #2266 Fix loss in segment announcements when segments do not fit in zNode
• add ChatHandlerServerModule to realtime example #2189 add ChatHandlerServerModule to realtime example
• fix tutorial so indexing service can start up #2338 Fix tutorial so indexing service can start up

Documentation

• add examples for duration and period granularities #1832 add examples for duration and period granularities
• "druid.manager.segment" should be "druid.manager.segments" #1843 "druid.manager.segment" should be "druid.manager.segments
• Fix documentation about lookup #1854 Fix documentation about lookup
• fix doc - correct default value for maxRowsInMemory #1900 fix doc - correct default value for maxRowsInMemory

Thanks to all the contributors to this release!

@b-slim
@binlijin
@dclim
@drcrallen
@fjy
@gianm
@guobingkun
@himanshug
@nishantmonu51
@pjain1
@xvrl

[gianm]

Added #2015, #1973, #2045, #2045, #1770, #1967, #1889 which were in rc2 & rc3

[xvrl]

https://github.com/druid-io/druid/releases/tag/druid-0.8.3