Skip to content

CUMULUS-4883: Add script to build Iceberg API docker image and push it to ECR as part of the build process.#4464

Merged
ygliuvt merged 6 commits into
masterfrom
cumulus-4883
May 22, 2026
Merged

CUMULUS-4883: Add script to build Iceberg API docker image and push it to ECR as part of the build process.#4464
ygliuvt merged 6 commits into
masterfrom
cumulus-4883

Conversation

@ygliuvt
Copy link
Copy Markdown
Member

@ygliuvt ygliuvt commented May 21, 2026

Summary: Summary of changes

Addresses CUMULUS-4883: Add script to build Iceberg API docker image and push it to ECR as part of the build process

Changes

  • Add script to build Iceberg API docker image and push it to ECR as part of the build process.
  • Added a Build Iceberg API Docker Image build step in Deploy Dev Integration Stack build stage. The new build step will build the Iceberg API image with the PR branch and push the image to the Sandbox ECR and update the ECS Iceberg API task to run with the newly built image.

See https://ci.earthdata.nasa.gov/browse/CUM-CBA4796 for the CI build.
You can use AWS console to verify the Iceberg API image that is built by the CICD is indeed pushed to ECR and deployed to ECS.
Verify that Iceberg api queries return the expected results.

PR Checklist

  • Update CHANGELOG
  • Unit tests
  • Ad-hoc testing - Deploy changes and test manually
  • Integration tests

📝 Note:
For most pull requests, please Squash and merge to maintain a clean and readable commit history.

@ygliuvt ygliuvt force-pushed the cumulus-4883 branch 2 times, most recently from 1d948ba to b0c6f57 Compare May 21, 2026 23:21

set_iceberg_image_version

DEPLOY_ICEBERG_API="${DEPLOY_ICEBERG_API:-false}"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You mentioned there's another variable - RUN_ICEBERG_INT_TEST - shouldn't we just have a single variable that if it's set will deploy the iceberg API and run the integration tests? Otherwise won't the default of RUN_ICEBERG_INT_TEST=true and DEPLOY_ICEBERG_API=false cause the build to fail because the API won't be running?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The integration test does not depend on the integration stack (I know it sounds bad) due to access issues from build agent to Sandbox environment. The integration test is run on a locally running server on the build agent so there is no connection between the two, thus two configurations.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"due to access issues from build agent to Sandbox environment." - would love to talk through why that is.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

where is this called?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In Bamboo. https://ci.earthdata.nasa.gov/build/admin/edit/editBuildTasks.action?buildKey=CUM-CBA-DDIS
I made it a conditional step before running the dev integration stack deployment

@ygliuvt ygliuvt merged commit 62d2352 into master May 22, 2026
7 of 9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants