Skip to content

Comments

Docs Ingestion page refactor#11541

Closed
techdocsmith wants to merge 107 commits intoapache:masterfrom
techdocsmith:ingestion
Closed

Docs Ingestion page refactor#11541
techdocsmith wants to merge 107 commits intoapache:masterfrom
techdocsmith:ingestion

Conversation

@techdocsmith
Copy link
Contributor

Refactor ingestion into smaller topics. Clean up some style here and there.

Description

This PR breaks down the ingestion landing page topic into smaller topics. Some benefits include:

  • Ingestion concepts like the Data Model, Rollup, and Partitioning now have smaller more focused topics.
  • The Ingestion spec reference stands alone as a reference topic.
  • Should make it easier to add conceptual or example material for a specific concept.

There may be some trade off in topic maintenance. For example if there's an enhancement to rollup, we may need to edit rollup.md and ingestion-spec.md.

This PR has:

  • been self-reviewed.
  • been tested in a test Druid cluster.

@techdocsmith
Copy link
Contributor Author

techdocsmith commented Aug 3, 2021

@sthetland & @vtlim , @loquisgon PTAL

@techdocsmith techdocsmith changed the title Ingestion Docs Ingestion page refactor Aug 3, 2021
Copy link

@sthetland sthetland left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good move splitting up the pages. Comments below.

techdocsmith and others added 9 commits August 3, 2021 13:02
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
@techdocsmith techdocsmith requested a review from sthetland August 3, 2021 20:24
* add_DynamicConfigProvider_for_schema_registry

* bug fixed

* add document

* fix document

* fix spot bug

* fix document

* inject ObjectMapper

* add DynamicConfigProviderUtils

* add UT

* bug fixed

Co-authored-by: yuanyi <yuanyi@freewheel.tv>
Copy link
Member

@vtlim vtlim left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I noticed a few other things I couldn't edit, will make the changes on my end and push to your branch

vtlim and others added 11 commits August 3, 2021 14:40
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
minor changes from review
Copy link

@sthetland sthetland left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Again, nice refactor. A few nits from some spot checking, but also I think a merge conflict snuck through.

techdocsmith and others added 20 commits August 10, 2021 19:13
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: sthetland <steve.hetland@imply.io>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
Co-authored-by: Victoria Lim <vtlim@users.noreply.github.com>
@techdocsmith
Copy link
Contributor Author

@sthetland , @suneet-s , I think I finally got all the merge conflicts, spelling, and link checking handled. What a challenge.

techdocsmith added a commit to techdocsmith/druid that referenced this pull request Aug 11, 2021
@techdocsmith
Copy link
Contributor Author

This PR got out of sync beyond repair. #11576 carries it. cc: @suneet-s , @sthetland

sthetland pushed a commit that referenced this pull request Aug 13, 2021
* Docs refactor of ingestion. Carries #11541

* Update docs/misc/math-expr.md

* add Apache license

* fix header, add topics to sidebar

* Update docs/ingestion/partitioning.md

* pick up changes to  and  md from c7fdf1d, #11479

Co-authored-by: Suneet Saldanha <suneet@apache.org>
Co-authored-by: Jihoon Son <jihoonson@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.