Skip to content

[DOCS] Add documentation around downgrading hudi table#9704

Merged
nsivabalan merged 2 commits intoapache:asf-sitefrom
lokeshj1703:docs_downgrade
Sep 14, 2023
Merged

[DOCS] Add documentation around downgrading hudi table#9704
nsivabalan merged 2 commits intoapache:asf-sitefrom
lokeshj1703:docs_downgrade

Conversation

@lokeshj1703
Copy link
Collaborator

Change Logs

Adds documentation in the deployment guide for downgrading a hudi table. Currently the documentation only discusses the Upgrade steps.

Impact

NA

Risk level (write none, low medium or high below)

low

Documentation Update

NA

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@lokeshj1703 lokeshj1703 changed the base branch from master to asf-site September 13, 2023 09:39
@lokeshj1703
Copy link
Collaborator Author

image


- [Deployment Model](#deploying) : How various Hudi components are deployed and managed.
- [Upgrading Versions](#upgrading) : Picking up new releases of Hudi, guidelines and general best-practices.
- [Upgrading/Downgrading Versions](#upgrading--downgrading) : Picking up new releases of Hudi, guidelines and general best-practices.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor.
we can make Upgrading and Downgrading as two diff bullets.
and fix the desc for downgrade.

- Always upgrade/downgrade the query bundles (mr-bundle, presto-bundle, spark-bundle) first and then upgrade/downgrade the writers (Hudi Streamer, spark jobs using datasource). This often provides the best experience and it's easy to fix
any issues by rolling forward/back the writer code (which typically you might have more control over)
- With large, feature rich releases we recommend migrating slowly, by first testing in staging environments and running your own tests. Upgrading Hudi is no different than upgrading any database system.
- With large, feature rich releases we recommend migrating slowly, by first testing in staging environments and running your own tests. Upgrading/Downgrading Hudi is no different than upgrading/downgrading any database system.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets not combine Upgrading and downgrading.
lets add a new section for downgrade.
Few things to consider

  • Lets call out that upgrade steps will get executed automatically when new hudi version is used and there is not human intervention required.
  • With downgrade, lets go over an example script. Create a table using 0.12.0. And then upgrade to 0.13.0. And then launch cli and execute downgrade.
  • Also, in downgrade lets add some explanation as to why someone might need to downgrade (motivation)

@nsivabalan nsivabalan merged commit 8cac243 into apache:asf-site Sep 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants