Skip to content

Adds documentation about the optimized PR workflow#12006

Merged
potiuk merged 1 commit intoapache:masterfrom
PolideaInternal:add-documentation-about-the-optimized-pr-workflow
Oct 31, 2020
Merged

Adds documentation about the optimized PR workflow#12006
potiuk merged 1 commit intoapache:masterfrom
PolideaInternal:add-documentation-about-the-optimized-pr-workflow

Conversation

@potiuk
Copy link
Copy Markdown
Member

@potiuk potiuk commented Oct 31, 2020

We had a lot of problems recently about the queues in Github
Actions. This documentations explains the motivation and approach
we have taken for optimizing our PR workflow.


^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

@potiuk potiuk force-pushed the add-documentation-about-the-optimized-pr-workflow branch from 77b6765 to f6eef4b Compare October 31, 2020 20:06
@github-actions
Copy link
Copy Markdown

The Workflow run is cancelling this PR. It in earlier duplicate of 1029499 run.

@potiuk
Copy link
Copy Markdown
Member Author

potiuk commented Oct 31, 2020

Promised documentation about the PR workflow. It was a bit emergency so I did not have time to add it before but here it is (cc: @TobKed).

Any comments, improvements, spelling etc. are most welcome.

Especially @ashb - since you had some doubts about whether the process is too heavy on the committers - maybe you can have some suggestions and improvement proposals here. I think PR form of the documentation is perfect if you have doubts and proposals to parts of the process. also once we sort out the self-hosted-runners security this will be a perfect place to add description about the architecture, deployments, and possibly modifications we've done to standard runners.

Also @dimberman - you seemed to be in favour of the whole approach, so if you have any comments, proposals. I am happy to update it.

Also the solution we came up with @TobKed is pretty flexible, so don't be shy when proposing improvements there. We can rather easily adapts some parts of it.

@potiuk potiuk force-pushed the add-documentation-about-the-optimized-pr-workflow branch from f6eef4b to 25e108f Compare October 31, 2020 20:17
Copy link
Copy Markdown
Member

@ashb ashb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, happy with this flow.

@ashb
Copy link
Copy Markdown
Member

ashb commented Oct 31, 2020

(My doubts expressed in slack were due to seeing a thread, but not the non-threaded discussion that lead up to it)

@potiuk potiuk force-pushed the add-documentation-about-the-optimized-pr-workflow branch from 25e108f to 1a1b5fd Compare October 31, 2020 22:18
Copy link
Copy Markdown
Member Author

@potiuk potiuk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All points updated. I changed "doc-only" (I think it was used in the past several times) to "no-code". I think it reflects better the actual scope of it. Happy to hear any proposal for a better name :)

@potiuk
Copy link
Copy Markdown
Member Author

potiuk commented Oct 31, 2020

Actually, this is a very good example of what's going on with the process here. This is the "no-code" change and it took literally 1m 25 seconds to pass all the necessary tests. :). I believe the direction we are going in is really good.

@github-actions github-actions bot added the okay to merge It's ok to merge this PR as it does not require more tests label Oct 31, 2020
@github-actions
Copy link
Copy Markdown

The PR is ready to be merged. No tests are needed!

We had a lot of problems recently about the queues in Github
Actions. This documentations explains the motivation and approach
we have taken for optimizing our PR workflow.
@potiuk potiuk force-pushed the add-documentation-about-the-optimized-pr-workflow branch from 1a1b5fd to 1728fbc Compare October 31, 2020 23:18
@potiuk
Copy link
Copy Markdown
Member Author

potiuk commented Oct 31, 2020

All resolved @kaxil :)

@potiuk
Copy link
Copy Markdown
Member Author

potiuk commented Oct 31, 2020

Let's wait 2 minutes :D

@potiuk
Copy link
Copy Markdown
Member Author

potiuk commented Oct 31, 2020

Done! Tests passed!

@potiuk potiuk merged commit d85a31f into apache:master Oct 31, 2020
@potiuk potiuk deleted the add-documentation-about-the-optimized-pr-workflow branch October 31, 2020 23:20
szn pushed a commit to szn/airflow that referenced this pull request Nov 1, 2020
We had a lot of problems recently about the queues in Github
Actions. This documentations explains the motivation and approach
we have taken for optimizing our PR workflow.
potiuk added a commit that referenced this pull request Nov 14, 2020
We had a lot of problems recently about the queues in Github
Actions. This documentations explains the motivation and approach
we have taken for optimizing our PR workflow.

(cherry picked from commit d85a31f)
@potiuk potiuk added this to the Airflow 1.10.13 milestone Nov 14, 2020
@potiuk potiuk added the type:misc/internal Changelog: Misc changes that should appear in change log label Nov 14, 2020
potiuk added a commit that referenced this pull request Nov 16, 2020
We had a lot of problems recently about the queues in Github
Actions. This documentations explains the motivation and approach
we have taken for optimizing our PR workflow.

(cherry picked from commit d85a31f)
potiuk added a commit that referenced this pull request Nov 16, 2020
We had a lot of problems recently about the queues in Github
Actions. This documentations explains the motivation and approach
we have taken for optimizing our PR workflow.

(cherry picked from commit d85a31f)
kaxil pushed a commit that referenced this pull request Nov 18, 2020
We had a lot of problems recently about the queues in Github
Actions. This documentations explains the motivation and approach
we have taken for optimizing our PR workflow.

(cherry picked from commit d85a31f)
cfei18 pushed a commit to cfei18/incubator-airflow that referenced this pull request Mar 5, 2021
We had a lot of problems recently about the queues in Github
Actions. This documentations explains the motivation and approach
we have taken for optimizing our PR workflow.

(cherry picked from commit d85a31f)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

okay to merge It's ok to merge this PR as it does not require more tests type:misc/internal Changelog: Misc changes that should appear in change log

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants