Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
52 commits
Select commit Hold shift + click to select a range
d1e798f
Adding nested columns documentation
writer-jill Aug 23, 2022
77d83a8
Updated docs to incorporate information on nested columns
writer-jill Aug 23, 2022
6b33313
Update data-formats.md
writer-jill Aug 23, 2022
a92b62a
Update nested-columns.md
writer-jill Aug 23, 2022
27ff7fb
Updated nested columns doc and related docs
writer-jill Aug 24, 2022
439a88a
Removed JSONPath syntax details and added link to this info
writer-jill Aug 24, 2022
6e4583e
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
5ac128f
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
7b14223
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
0246d12
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
964908c
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
334c03e
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
ade40e4
Updated examples and screenshots
writer-jill Aug 25, 2022
6a4ca3d
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
2d95098
Update nested-columns.md
writer-jill Aug 25, 2022
46b39b0
Update sql-data-types.md
writer-jill Aug 25, 2022
ca78845
Adding nested columns documentation
writer-jill Aug 23, 2022
a935fbc
Updated docs to incorporate information on nested columns
writer-jill Aug 23, 2022
e58426b
Update data-formats.md
writer-jill Aug 23, 2022
a6eb075
Update nested-columns.md
writer-jill Aug 23, 2022
79a1aff
Updated nested columns doc and related docs
writer-jill Aug 24, 2022
381a172
Removed JSONPath syntax details and added link to this info
writer-jill Aug 24, 2022
a129cda
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
fe060ab
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
a414125
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
bbda83c
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
e598bf5
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
b34e69f
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
0f0dceb
Updated examples and screenshots
writer-jill Aug 25, 2022
898d0ca
Update docs/querying/nested-columns.md
writer-jill Aug 25, 2022
0cc9035
Update nested-columns.md
writer-jill Aug 25, 2022
e88fc56
Update sql-data-types.md
writer-jill Aug 25, 2022
313de1d
Merge branch 'apachenested' of https://github.com/writer-jill/druid i…
writer-jill Aug 25, 2022
d8e2cb4
Update docs/querying/nested-columns.md
techdocsmith Aug 29, 2022
8850123
Update docs/querying/nested-columns.md
techdocsmith Aug 29, 2022
f380a45
Update docs/querying/nested-columns.md
techdocsmith Aug 29, 2022
1b3f087
adds case for deserialized JSON to nested columns
techdocsmith Aug 29, 2022
0d4ca26
Update docs/querying/nested-columns.md
techdocsmith Aug 29, 2022
2e600e5
Update docs/querying/nested-columns.md
techdocsmith Aug 29, 2022
c6d68e5
Update docs/querying/nested-columns.md
techdocsmith Aug 29, 2022
604d8d5
Update nested-columns.md
techdocsmith Aug 29, 2022
bbd5fd8
Update docs/querying/nested-columns.md
techdocsmith Aug 29, 2022
cde1d09
accept suggestions
techdocsmith Aug 30, 2022
23c27d3
Merge pull request #1 from techdocsmith/add-deserialized
writer-jill Aug 30, 2022
eddc083
Update docs/querying/nested-columns.md
writer-jill Aug 30, 2022
51568a8
Update docs/querying/nested-columns.md
writer-jill Aug 30, 2022
47536e6
Update docs/querying/nested-columns.md
writer-jill Aug 30, 2022
44a0cbd
Update math-expr.md
techdocsmith Aug 30, 2022
5fbdd13
Update docs/querying/nested-columns.md
techdocsmith Aug 30, 2022
bab19af
Update docs/querying/nested-columns.md
techdocsmith Aug 30, 2022
8529fab
Merge remote-tracking branch 'upstream/master' into apachenested
writer-jill Sep 6, 2022
349631a
fix typos
317brian Sep 6, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added docs/assets/nested-combined-json.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-display-data-types.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-examine-schema.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-extract-as-type.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-extract-elements.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-group-aggregate.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-msq-ingestion-transform.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-msq-ingestion.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-parse-deserialize.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-retrieve-json.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/nested-return-json.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 3 additions & 1 deletion docs/ingestion/data-formats.md
Original file line number Diff line number Diff line change
Expand Up @@ -582,7 +582,9 @@ For example:

### FlattenSpec

The `flattenSpec` object bridges the gap between potentially nested input data, such as JSON or Avro, and Druid's flat data model. It is an object within the `inputFormat` object.
The `flattenSpec` object bridges the gap between potentially nested input data, such as Avro or ORC, and Druid's flat data model. It is an object within the `inputFormat` object.

> If you have nested JSON data, you can ingest and store JSON in an Apache Druid column as a `COMPLEX<json>` data type. See [Nested columns](../querying/nested-columns.md) for more information.

Configure your `flattenSpec` as follows:

Expand Down
2 changes: 1 addition & 1 deletion docs/ingestion/ingestion-spec.md
Original file line number Diff line number Diff line change
Expand Up @@ -223,7 +223,7 @@ Dimension objects can have the following components:

| Field | Description | Default |
|-------|-------------|---------|
| type | Either `string`, `long`, `float`, or `double`. | `string` |
| type | Either `string`, `long`, `float`, `double`, or `json`. | `string` |
| name | The name of the dimension. This will be used as the field name to read from input records, as well as the column name stored in generated segments.<br><br>Note that you can use a [`transformSpec`](#transformspec) if you want to rename columns during ingestion time. | none (required) |
| createBitmapIndex | For `string` typed dimensions, whether or not bitmap indexes should be created for the column in generated segments. Creating a bitmap index requires more storage, but speeds up certain kinds of filtering (especially equality and prefix filtering). Only supported for `string` typed dimensions. | `true` |
| multiValueHandling | Specify the type of handling for [multi-value fields](../querying/multi-value-dimensions.md). Possible values are `sorted_array`, `sorted_set`, and `array`. `sorted_array` and `sorted_set` order the array upon ingestion. `sorted_set` removes duplicates. `array` ingests data as-is | `sorted_array` |
Expand Down
8 changes: 4 additions & 4 deletions docs/ingestion/schema-design.md
Original file line number Diff line number Diff line change
Expand Up @@ -201,8 +201,9 @@ like `MILLIS_TO_TIMESTAMP`, `TIME_FLOOR`, and others. If you're using native Dru

### Nested dimensions

At the time of this writing, Druid does not support nested dimensions. Nested dimensions need to be flattened. For example,
if you have data of the following form:
You can ingest and store nested JSON in a Druid column as a `COMPLEX<json>` data type. See [Nested columns](../querying/nested-columns.md) for more information.

If you want to ingest nested data in a format other than JSON&mdash;for example Avro, ORC, and Parquet&mdash;you must use the `flattenSpec` object to flatten it. For example, if you have data of the following form:

```
{"foo":{"bar": 3}}
Expand All @@ -214,8 +215,7 @@ then before indexing it, you should transform it to:
{"foo_bar": 3}
```

Druid is capable of flattening JSON, Avro, or Parquet input data.
Please read about [`flattenSpec`](./ingestion-spec.md#flattenspec) for more details.
See the [`flattenSpec`](./ingestion-spec.md#flattenspec) documentation for more details.

<a name="counting"></a>

Expand Down
2 changes: 1 addition & 1 deletion docs/misc/math-expr.md
Original file line number Diff line number Diff line change
Expand Up @@ -252,7 +252,7 @@ Druid supports a small, simplified subset of the [JSONPath syntax](https://githu
|`['<name>']`| Child element in bracket notation. |
|`[<number>]`| Array index. |

See [SQL JSON documentation](../querying/sql-json-functions.md#jsonpath-syntax) for examples.
See [SQL JSON documentation](../querying/sql-json-functions.md#jsonpath-syntax) for examples and [Nested columns](../querying/nested-columns.md) for more information on ingesting and storing nested data.

## Reduction functions

Expand Down
Loading