[airbyte-ci] build python connectors from base images

[alafanechere]

What

Closes #30236
Make our Python connector build step use the base image versions declared in the airbyte-connectors-base-images
package.

How

• Change BuildConnectorImage to build a connector from the base image version it defined in the metadata,
  otherwise fallback to a dockerfile build.
• Unit test these changes.

🚨 User Impact 🚨

Any connector declaring the baseImage metadata field will get built using the base image instead of its Dockerfile.

Next steps:

Implement the pre/post build hook logic: #30526

[alafanechere]

Current dependencies on/for this PR:

• master
  • PR [airbyte-ci] build python connectors from base images #30456 👈
    • PR [airbyte-ci] implement pre/post build hooks #30526
      • PR [airbyte-ci]: new check on python certified connector to validate their base image use #30527
        • PR Make certified python connectors use our base image #30528
    • PR [airbyte-ci] Implement pre/post build hooks #30513
    • PR [airbyte-ci] test connectors inside their built container #30474
    • PR [QA checks] tolerate connector without dockerfile #30467
      • PR [airbyte-ci] introduce an autocommit command to update base image version to the latest one #30508
      • PR source-file/faker: make them use our base image + delete dockerfile #30468
    • PR make QA checks handle missing dockerfiles #30458

This comment was auto-generated by Graphite.

[airbyte-oss-build-runner]

source-auth0 test report (commit 28dc026757) - ✅

⏲️ Total pipeline duration: 01mn47s

Step	Result
Connector package install	✅
Build source-auth0 docker image for platform(s) linux/x86_64	✅
Acceptance tests	✅
Code format checks	✅
Validate metadata for source-auth0	✅
Connector version semver check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-auth0 test

[alafanechere]

Successfully ran a pre-release of source-faker from this branch

[alafanechere]

@bnchrch and @pedroslopez I reverted the changes for source-file-(secure). Why:

• Changes on the source-file-secure setup.py require a version bump
• The source-file-secure version must match the source-file version
• source-file test are broken (currently under fix in 🐛 source-file: fix integration tests #31152 )

I suggest to fix and bump both of these connector (and 🪓 the source-file Dockerfile) in a separate PR (I'll take car of it). This leads to a temporary code freeze on source-file.

[airbyte-oss-build-runner]

source-auth0 test report (commit 637103fc7b) - ✅

⏲️ Total pipeline duration: 48.24s

Step	Result
Connector package install	✅
Build source-auth0 docker image for platform(s) linux/x86_64	✅
Acceptance tests	✅
Code format checks	✅
Validate metadata for source-auth0	✅
Connector version semver check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-auth0 test

[airbyte-oss-build-runner]

source-auth0 test report (commit 9e0793412e) - ✅

⏲️ Total pipeline duration: 01mn02s

Step	Result
Connector package install	✅
Build source-auth0 docker image for platform(s) linux/x86_64	✅
Acceptance tests	✅
Code format checks	✅
Validate metadata for source-auth0	✅
Connector version semver check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-auth0 test

[airbyte-oss-build-runner]

source-auth0 test report (commit 5e1cacba6a) - ✅

⏲️ Total pipeline duration: 01mn51s

Step	Result
Connector package install	✅
Build source-auth0 docker image for platform(s) linux/x86_64	✅
Acceptance tests	✅
Code format checks	✅
Validate metadata for source-auth0	✅
Connector version semver check	✅
QA checks	✅

🔗 View the logs here

☁️ View runs for commit in Dagger Cloud

Please note that tests are only run on PR ready for review. Please set your PR to draft mode to not flood the CI engine and upstream service on following commits.
You can run the same pipeline locally on this branch with the airbyte-ci tool with the following command

airbyte-ci connectors --name=source-auth0 test

[bnchrch]

This is the most beautiful PR I have ever seen 😍

lets merge it.