Skip to content

This table represents the list of all alembic revisions until 2.0.0#12792

Closed
ernest-kr wants to merge 2 commits intoapache:masterfrom
ernest-kr:alembic_revisions
Closed

This table represents the list of all alembic revisions until 2.0.0#12792
ernest-kr wants to merge 2 commits intoapache:masterfrom
ernest-kr:alembic_revisions

Conversation

@ernest-kr
Copy link
Contributor

Created a table with the list of all alembic revisions until 2.0.0

Closes: #11989


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@boring-cyborg
Copy link

boring-cyborg bot commented Dec 3, 2020

Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution Guide (https://github.com/apache/airflow/blob/master/CONTRIBUTING.rst)
Here are some useful points:

  • Pay attention to the quality of your code (flake8, pylint and type annotations). Our pre-commits will help you with that.
  • In case of a new feature add useful documentation (in docstrings or in docs/ directory). Adding a new operator? Check this short guide Consider adding an example DAG that shows how users should use it.
  • Consider using Breeze environment for testing locally, it’s a heavy docker but it ships with a working Airflow and a lot of integrations.
  • Be patient and persistent. It might take some time to get a review or get the final approval from Committers.
  • Please follow ASF Code of Conduct for all communication including (but not limited to) comments on Pull Requests, Mailing list and Slack.
  • Be sure to read the Airflow Coding style.
    Apache Airflow is a community-driven project and together we are making it better 🚀.
    In case of doubts contact the developers at:
    Mailing List: dev@airflow.apache.org
    Slack: https://s.apache.org/airflow-slack

@mik-laj
Copy link
Member

mik-laj commented Dec 3, 2020

@ernest-kr Do you think we can generate these tables automatically?

Copy link
Member

@mik-laj mik-laj Dec 3, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file wasn't added to the TOC. Am I right?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @mik-laj , I have not checked if we can generate this table automatically. Since we display them in the logs , I think there could be a way to generate them.

This is not added yet to the table of contents.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe it is good to merge for RC1 as is @mik-laj -> we can automate it the first time we add a new migration. WDYT?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can merge this now, but I don't find it difficult to automate the generation of these tables.
Code that gets the migration list:
https://github.com/sqlalchemy/alembic/blob/master/alembic/command.py
Custom directives that render templates based on jinja:
https://github.com/apache/airflow/blob/master/docs/exts/operators_and_hooks_ref.py#L176-L205 + tabulate with rst output

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to have it tomorrow @ernest-kr -> do you think you can automate it ? BTW. You will also have to include #12890 when merged

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi , Unfortunately I do not have time to finish by tomorrow on this. Can you create a new issue for the automate task so I can work on it?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No problem. Will do :)

@potiuk potiuk added this to the Airflow 2.0.0rc1 milestone Dec 7, 2020
@kaxil kaxil self-requested a review December 7, 2020 17:43
@potiuk
Copy link
Member

potiuk commented Dec 7, 2020

I think we need to exclude the doc from spell-check though @mik-laj @kaxil ? do you know how to do it ?

@mik-laj
Copy link
Member

mik-laj commented Dec 7, 2020

I think we need to exclude the doc from spell-check though @mik-laj @kaxil ? do you know how to do it ?

Why do you want to exclude this file? I guess identifiers should simply be written as a code literal and then they won't be checked by spell check.

- Revises ID
- Airflow Version
- Summary
* - e3a246e0dc1
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* - e3a246e0dc1
* - `e3a246e0dc1`

- Airflow Version
- Summary
* - e3a246e0dc1
- 1507a7289a2f
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- 1507a7289a2f
- `1507a7289a2f`

- Summary
* - e3a246e0dc1
- 1507a7289a2f
- 2.0.0
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- 2.0.0
- `2.0.0`

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Did you want this to be a code literal, if so

Suggested change
- 2.0.0
- ``2.0.0``

* - e3a246e0dc1
- 1507a7289a2f
- 2.0.0
- create is_encrypted
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- create is_encrypted
- create `is_encrypted`

* - bba5a7cfc896
- 1968acfc09e3
- 2.0.0
- add is_encrypted column to variable table
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- add is_encrypted column to variable table
- add `is_encrypted` column to variable table

@ashb
Copy link
Member

ashb commented Dec 7, 2020

I think we need to exclude the doc from spell-check though @mik-laj @kaxil ? do you know how to do it ?

Why do you want to exclude this file? I guess identifiers should simply be written as a code literal and then they won't be checked by spell check.

There's a lot of identifiers.

The following table shows the list of alembic revisions


.. list-table:: Alembic Revisions(until Airflow 2.0.0):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this just migrations since 1.10.14?

If so

Suggested change
.. list-table:: Alembic Revisions(until Airflow 2.0.0):
.. list-table:: Alembic Revisions (from Airflow 2.0.0 onwards):

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let me make these changes and modify my pull request

@kaxil
Copy link
Member

kaxil commented Dec 7, 2020

The orders (and down_revision) have changed after #12896 was merged

- maintain history for compatibility with earlier migrations
* - 13eb55f81627
- 338e90f54d61
- 2.0.0
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All the migrations have version 2.0.0 which is incorrect. If you check the example I have in #11989 -- we want to show which migration was added in which Version example 1.10.10, 1.10.12 etc

@github-actions
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the stale Stale PRs per the .github/workflows/stale.yml policy file label Feb 28, 2021
@github-actions github-actions bot closed this Mar 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind:documentation stale Stale PRs per the .github/workflows/stale.yml policy file

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Doc page containing list of Alembic DB Migrations

5 participants

Comments