-
Notifications
You must be signed in to change notification settings - Fork 4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[EPIC] - Connectors CI/CD Pipeline in Production #24403
Comments
Project update 04/04/2023:✅ What's been completed:
🚧 What got in the way:
🌱 What's next:
❓ Learning / Questions / Changes:
⛔ Blockers:
|
@bnchrch do you think we can descope the connector health report generation from this project? I think it's also scoped in the metadata project. |
✅ What's been completed:
🚧 What got in the way:
🌱 What's next:
⛔ Blockers:
|
Weekly project update: Connectors CI/CD Pipeline in Production
🚧 What got in the way: After merging the PR enabling testing all our connectors (Java / Python / Low Code) we suffered from a huge performance loss due to caching issues in Dagger. We reached out to the dagger team to understand the root cause. Nuking the Dagger engine and the runner made this problem disappear (not nuking the cache!). I’m going to monitor the pipelines closely this week to check if the problems reoccurs. 🌱 What's next:
⛔ Blockers: No hard blocker at the moment but infra instabilities require extra communications and collaborations with the infra / Dagger teams that can impact the project velocity. |
Weekly project update: Connectors CI/CD Pipeline in Production ✅ What's been completed:
🚧 What got in the way:
🌱 What's next:
⛔ Blockers: No hard blocker at the moment but infra instabilities require extra communications and collaborations with the infra / Dagger teams that can impact the project velocity. |
Weekly project update: Connectors CI/CD Pipeline in Production ✅ What's been completed:
🚧 What got in the way:
🌱 What's next:
|
Weekly project update: Connectors CI/CD Pipeline in Production ✅ What's been completed:
🚧 What got in the way
⛔ Blocker
|
Weekly project update: Connectors CI/CD in production [PUBLISH ON MERGE FOCUS]✅ What's been accomplished:Isolate environmentsTo maximize the publish pipeline availability Conor and the dagger team provisioned a separate set of runners for connector testing. Publish and test are not sharing the same cache anymore, so test should not corrupt the publish environment. Test
Prepare
|
Weekly project update:✅ What's been accomplished
|
Weekly project update✅ What was done
🌱 Next steps:We’d like to be code complete in term of pipeline logic this week:
In parallel I expect continued investigation from the Dagger team on our infra problems. I’d like to focus the next week on:
⛔ BlockersThe infra instabilities still delay stable nightly builds for an in-depth comparison of /test results to dagger tests results. Here are the three problems we're actively investigating with the Dagger team:
|
Connectors CI/CD weekly update✅ What's been accomplished:
|
Closing this epic as both publish and test pipelines are in production. |
Definition of done:
Milestone:
The text was updated successfully, but these errors were encountered: