Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

External Secrets Store Support: AWS Secrets Manager #10518

Closed
Tracked by #837
cgardens opened this issue Feb 21, 2022 · 2 comments
Closed
Tracked by #837

External Secrets Store Support: AWS Secrets Manager #10518

cgardens opened this issue Feb 21, 2022 · 2 comments
Labels
accepting-contributions Feel free to contribute to them area/platform issues related to the platform team/compose team/platform-move type/enhancement New feature or request

Comments

@cgardens
Copy link
Contributor

cgardens commented Feb 21, 2022

epic: #837

Tell us about the problem you're trying to solve

Currently, Airbyte only integrates with one external secrets store: GCP Secrets Manager. Users on AWS prefer to use AWS Secrets Manager.

Describe the solution you’d like

Add AWS Secrets Manager as an option for external secrets.

Describe the alternative you’ve considered or used

A clear and concise description of any alternative solutions or features you've considered or are using today. We already have a SecretsPersistence interface to work with. The existing GCP Secrets Manager implementation can be found in the class GoogleSecretManagerPersistence. Basically we need to:

  1. Implement SecretsPersistence for AWS Secrets Manager with tests similar to what already exists.
  2. Allow setting appropriate env variable to configure it and pipe through that configuration into the app.

In terms of external contribution part 1 should be very doable. We would be happy to help on part 2 once tests are passing for part 1.

@cgardens cgardens added type/enhancement New feature or request accepting-contributions Feel free to contribute to them area/platform issues related to the platform labels Feb 21, 2022
pmossman pushed a commit that referenced this issue Dec 1, 2022
#10518

Added new implementation AWSSecretManagerPersistence and integration tests AWSSecretManagerPersistenceIntegrationTest

A new implementation of SecretPersistence to support AWS Secret Manager AWSSecretManagerPersistence
New Integration tests as suggested on the open Issue, similar to GCP secret manager
pmossman pushed a commit that referenced this issue Dec 2, 2022
#10518

Added new implementation AWSSecretManagerPersistence and integration tests AWSSecretManagerPersistenceIntegrationTest

A new implementation of SecretPersistence to support AWS Secret Manager AWSSecretManagerPersistence
New Integration tests as suggested on the open Issue, similar to GCP secret manager
pmossman pushed a commit that referenced this issue Dec 9, 2022
#10518

Added new implementation AWSSecretManagerPersistence and integration tests AWSSecretManagerPersistenceIntegrationTest

A new implementation of SecretPersistence to support AWS Secret Manager AWSSecretManagerPersistence
New Integration tests as suggested on the open Issue, similar to GCP secret manager
pmossman pushed a commit to mauricioalarcon/airbyte that referenced this issue Dec 12, 2022
airbytehq#10518

Added new implementation AWSSecretManagerPersistence and integration tests AWSSecretManagerPersistenceIntegrationTest

A new implementation of SecretPersistence to support AWS Secret Manager AWSSecretManagerPersistence
New Integration tests as suggested on the open Issue, similar to GCP secret manager
pmossman pushed a commit to mauricioalarcon/airbyte that referenced this issue Dec 12, 2022
airbytehq#10518

Added new implementation AWSSecretManagerPersistence and integration tests AWSSecretManagerPersistenceIntegrationTest

A new implementation of SecretPersistence to support AWS Secret Manager AWSSecretManagerPersistence
New Integration tests as suggested on the open Issue, similar to GCP secret manager
pmossman added a commit that referenced this issue Dec 12, 2022
* 🎉 New implementation for AWS Secret Manager for issue
#10518

Added new implementation AWSSecretManagerPersistence and integration tests AWSSecretManagerPersistenceIntegrationTest

A new implementation of SecretPersistence to support AWS Secret Manager AWSSecretManagerPersistence
New Integration tests as suggested on the open Issue, similar to GCP secret manager

* Updated version to `aws-secretsmanager-caching-java:1.0.2`
- Added new argument check for AWS Secret Manager.

* exclude jackson-databind from aws dependency and run gradle format

* bump aws-related dependencies to prevent old version of jackson-databind from being pulled in

* - Added new entry for `AWS_SECRET_MANAGER` into SecretPersistence.java
- Externalized configurations for AWS Secret Manager into Configs and EnvConfigs.java as requested.
- Adjusted test to use new constructor for `AWSSecretManagerPersistence`
- Augmented instructions configuring-airbyte.md with the new config keys.

* Formatting code.

* revert dependency version bump

Co-authored-by: pmossman <parker@airbyte.io>
Co-authored-by: mauricioalarcon <unknown>
@davinchia
Copy link
Contributor

This is done!

@nataliekwong
Copy link
Contributor

fyi @tryangul I saw this was referenced in a recent customer conversation and is now completed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
accepting-contributions Feel free to contribute to them area/platform issues related to the platform team/compose team/platform-move type/enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

4 participants