connectors-ci: pass PR id to airbyte-ci

[alafanechere]

What

1/2 to complete #24322
Closes #25279
We want to get the pull request id (aka pull request number) in the CI context to:

• Add PR link to test reports that are stored to S3
• Check if the PR is draft and stop the test pipeline if the PR is still in draft mode
• Write test reports as comments PR

How

• Pass the PR ID from GHA to airbyte-ci as an env var
• Retrieve the PR object and store it in the context object
• Make the test report write comment to PRs on context teardown

🚨 User Impact 🚨

• The automated test on PR will be re-enabled, will help assess their stability or debug their instability at scalre
• The PR comment will not be posted until we set the PRODUCTION env var to True.

[octavia-squidington-iii]

🔥 source-pokeapi test report 🔥

⏲️ Total pipeline duration: 115 seconds

Step	Result
Connector version semver check.	✅
Connector version increment check.	❌
QA checks	❌
Code format checks	✅
Connector package install	✅
Build source-pokeapi docker image for platform linux/x86_64	✅
Unit tests	✅
Integration tests	🟡
Acceptance tests	❌
🔗 View the logs here

Please note that tests are only run on PR ready for review.
Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-pokeapi test

[evantahler]

Notes from Retro:

• maybe replace the 🔥 emoji with the connector icons
• make sure the comment is updated if you post on success too
• probably also want the build summary

[octavia-squidington-iii]

source-pokeapi test report (commit d3f343fa30) - ❌

⏲️ Total pipeline duration: 83 seconds

Step	Result
Connector version semver check.	✅
Connector version increment check.	❌
QA checks	✅
Code format checks	✅
Connector package install	✅
Build source-pokeapi docker image for platform linux/x86_64	✅
Unit tests	✅
Acceptance tests	❌

🔗 View the logs here

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-pokeapi test

[octavia-squidington-iii]

source-openweather test report (commit d3f343fa30) - ✅

⏲️ Total pipeline duration: 163 seconds

Step	Result
Connector version semver check.	✅
Connector version increment check.	✅
QA checks	✅
Code format checks	✅
Connector package install	✅
Build source-openweather docker image for platform linux/x86_64	✅
Unit tests	✅
Acceptance tests	✅

🔗 View the logs here

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-openweather test

[alafanechere]

@evantahler I did the following improvements:

• Icons are displayed
• An emoji in the comment title shows the global status
• I added the commit for which the test ran in the commit title

I believe we should not update comments and create one comment per test run as it helps tracking which commit led to different test results. And it's tedious to update a comment because our jobs are stateless and I can keep the comment ID around to update it on a different pipeline run.

[alafanechere]

Due to current infra problems it's not safe to enable the automated test pipeline right now - concurrent jobs are blocking each other.

[bnchrch]

@alafanechere if im reading this right then this workflow will run on "all" opened/ready for review PRs

Do we not want to keep these path filters so it runs on "all connector related" prs instead?

[alafanechere]

This pipeline will eventually run on all PRs to make the required check pass...

[alafanechere]

The pipeline will run when:

• the pr is opened
• when a commit is pushed to the pr
• when the pr is made ready for review

But the tests will run only if the PR is not in draft mode thank to this change

[evantahler]

• Icons are displayed

NICE

• An emoji in the comment title shows the global status

✅

• I added the commit for which the test ran in the commit title

I believe we should not update comments and create one comment per test run as it helps tracking which commit led to different test results. And it's tedious to update a comment because our jobs are stateless and I can keep the comment ID around to update it on a different pipeline run.

Ok, that's fine for now. We can revisit this if it gets annoying. As a note, you can see a comment's history if you do want it:

[bnchrch]

One small comment. Other than that LGTM!

[bnchrch]

@alafanechere if im reading this right then this workflow will run on "all" opened/ready for review PRs

Do we not want to keep these path filters so it runs on "all connector related" prs instead?

[alafanechere]

One small comment. Other than that LGTM!

Do we not want to keep these path filters so it runs on "all connector related" prs instead?

@bnchrch If we want to create a required PR check it'll have to run on all PRs...
This portion of the code will guarantee that the Global CI check will be updated to success even if not connector got tested on an unrelated PR:

airbyte/tools/ci_connector_ops/ci_connector_ops/pipelines/commands/groups/connectors.py

Lines 156 to 158 in 14c854e

	click.secho("No connector were selected for testing.", fg="yellow")
	update_global_commit_status_check_for_tests(ctx.obj, "success")
	return True