Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates to KV controller from Ace #80

Merged
merged 8 commits into from
Aug 20, 2019

Conversation

jananivMS
Copy link
Contributor

@jananivMS jananivMS commented Aug 14, 2019

What this PR does / why we need it:
This PR makes the following changes to the KV controller submitted by Ace:

  1. Update vault creation to be asynchronous.
  2. Update logging statements to only log actual errors.
  3. Check for particular errors - Resource group not found, Async operation not complete - and requeue if these errors occur.
  4. Moved the resourcemanager to the pkg directory to align with the rest of the code.

Tested this using the local docker kubernetes using kubebuilder's make run & created/deleted keyvaults

Special notes for your reviewer:

  • Erin - review to make sure this aligns with the rest of the structure. Feel free to post comments where it is not.
  • Ace - Please make sure nothing in your original logic is changes

If applicable:

  • this PR contains documentation
  • this PR contains tests

@jananivMS jananivMS changed the title Jananiv/kvchanges Updates to KV controller from Ace Aug 14, 2019
@jananivMS
Copy link
Contributor Author

jananivMS commented Aug 14, 2019 via email

@alexeldeib
Copy link
Contributor

LGMT pending minor updates to status subresource and image tag. Feel free to close the other PR, or I can if we're assuming this supersedes.

Copy link
Contributor

@frodopwns frodopwns left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

some comments and some changes

config/samples/azure_v1_keyvault.yaml Outdated Show resolved Hide resolved
config/samples/creator_v1_eventhub.yaml Outdated Show resolved Hide resolved
config/samples/creator_v1_eventhubnamespace.yaml Outdated Show resolved Hide resolved
config/samples/creator_v1_resourcegroup copy.yaml Outdated Show resolved Hide resolved
config/samples/creator_v1_resourcegroup.yaml Outdated Show resolved Hide resolved
controllers/keyvault_controller.go Show resolved Hide resolved
controllers/keyvault_controller.go Show resolved Hide resolved
controllers/keyvault_controller.go Show resolved Hide resolved
controllers/keyvault_controller.go Show resolved Hide resolved
main.go Show resolved Hide resolved
@jananivMS
Copy link
Contributor Author

Updated comments. I will be opening two new issues for changes not addressed here:

  1. Task for handling requeue duration correctly
  2. Ensuring "update" to keyvault resource is handled correctly

Copy link
Contributor

@frodopwns frodopwns left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, we can address the provisioning state stuff Ace mentioned in another PR

@frodopwns frodopwns merged commit daf4247 into Azure:master Aug 20, 2019
frodopwns added a commit that referenced this pull request Aug 21, 2019
* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>
WilliamMortlMicrosoft added a commit that referenced this pull request Aug 22, 2019
* first commit on Amanda's branch

* first

* before properties

* test not tested

* test works

* need to handled unexpected error types...like validation.error (#111)

* refactor tests  (#90)

* improve tests with parallel execution and rm sleep

* fix the tests to run on kindcluster

* Updates to KV controller from Ace (#80) (#112)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>

* unit tests work, needs firewall rules

* addresses feedback

* erin's feedback
jananivMS added a commit that referenced this pull request Aug 28, 2019
* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

* need to handled unexpected error types...like validation.error (#111)

* refactor tests  (#90)

* improve tests with parallel execution and rm sleep

* fix the tests to run on kindcluster

* Updates to KV controller from Ace (#80) (#112)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>

* adding sql server tests

* wwqw:wq

* SqlDatabase controller changes
WilliamMortlMicrosoft added a commit that referenced this pull request Aug 28, 2019
* need to handled unexpected error types...like validation.error (#111)

* refactor tests  (#90)

* improve tests with parallel execution and rm sleep

* fix the tests to run on kindcluster

* Updates to KV controller from Ace (#80) (#112)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>

* Test update (#115)

* this needs to exist in the reconciler in order to use controllerutil createorupdate

* Feat/add consumer group kind (#117)

* add consumer group kind

* update tests for consumer group

* fix isbeingdeleted

* Updates to README - steps for onboarding (#114)

* cluster additions

* updated docs

* Update azure-pipelines.yaml (#119)

* Update azure-pipelines.yaml

* fix tests (#140)

* revert back // +kubebuilder:subresource:status changes - fix broken tests

* Devcontainer to Help Onboard New People (#142)

* add dev conatiner - wip

* DevContainer up and running.

* Removed `sleep 80` and replaced with `kubectl wait`.

* Run `make set-kindcluster` from docker-compose.

* Set timeout on wait.

* Added `install-test-dependency` to makefile and dockerfile.

* Update README - Create SP with contribution rights.

* Updated README with details on using devcontainer.

* Stuff that wanted me to commit.

* Reverted changes made to `docker-build` in Makefile.

* pass future where possible instead of bool (#121)

* first commit on Amanda's branch

* first

* before properties

* test not tested

* test works

* unit tests work, needs firewall rules

* addresses feedback

* erin's feedback

* janani's change, pass future

* async works much better now

* janani feedback

* screwed up interface prototype

* firewall settings and unit tests

* firewall rule deletion
@jananivMS jananivMS deleted the jananiv/kvchanges branch August 28, 2019 21:36
frodopwns added a commit that referenced this pull request Aug 29, 2019
* need to handled unexpected error types...like validation.error (#111)

* refactor tests  (#90)

* improve tests with parallel execution and rm sleep

* fix the tests to run on kindcluster

* Updates to KV controller from Ace (#80) (#112)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>

* Test update (#115)

* this needs to exist in the reconciler in order to use controllerutil createorupdate

* Feat/add consumer group kind (#117)

* add consumer group kind

* update tests for consumer group

* fix isbeingdeleted

* Updates to README - steps for onboarding (#114)

* cluster additions

* updated docs

* Update azure-pipelines.yaml (#119)

* Update azure-pipelines.yaml

* fix tests (#140)

* revert back // +kubebuilder:subresource:status changes - fix broken tests

* Devcontainer to Help Onboard New People (#142)

* add dev conatiner - wip

* DevContainer up and running.

* Removed `sleep 80` and replaced with `kubectl wait`.

* Run `make set-kindcluster` from docker-compose.

* Set timeout on wait.

* Added `install-test-dependency` to makefile and dockerfile.

* Update README - Create SP with contribution rights.

* Updated README with details on using devcontainer.

* Stuff that wanted me to commit.

* Reverted changes made to `docker-build` in Makefile.

* pass future where possible instead of bool (#121)

* first commit on Amanda's branch

* first

* before properties

* test not tested

* test works

* unit tests work, needs firewall rules

* addresses feedback

* erin's feedback

* janani's change, pass future

* async works much better now

* janani feedback

* screwed up interface prototype

* randomize the resources names used in tests (#152)

* Ability to Set SecretName When Creating Event Hub (#151)

* Updated eventhub_types - Added `secretName`.

* Added `secretName` to sample manifest.

* Set secret name to `secretName` if set, otherwise use eventhub name.

* Updated Makefile to update Azure Operator.

Also added the ability to rebuild image without cache.

* Updated README on how to update the Azure Operator.

* Updated CRD with SecretName description.

* Added tests to ensure `SecretName` was being used if present.

* Fix test.

* fixing issues from merge
jananivMS added a commit that referenced this pull request Aug 29, 2019
#160)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

* need to handled unexpected error types...like validation.error (#111)

* refactor tests  (#90)

* improve tests with parallel execution and rm sleep

* fix the tests to run on kindcluster

* Updates to KV controller from Ace (#80) (#112)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>

* Test update (#115)

* this needs to exist in the reconciler in order to use controllerutil createorupdate

* Feat/add consumer group kind (#117)

* add consumer group kind

* update tests for consumer group

* fix isbeingdeleted

* Updates to README - steps for onboarding (#114)

* cluster additions

* updated docs

* Update azure-pipelines.yaml (#119)

* Update azure-pipelines.yaml

* fix tests (#140)

* revert back // +kubebuilder:subresource:status changes - fix broken tests

* Devcontainer to Help Onboard New People (#142)

* add dev conatiner - wip

* DevContainer up and running.

* Removed `sleep 80` and replaced with `kubectl wait`.

* Run `make set-kindcluster` from docker-compose.

* Set timeout on wait.

* Added `install-test-dependency` to makefile and dockerfile.

* Update README - Create SP with contribution rights.

* Updated README with details on using devcontainer.

* Stuff that wanted me to commit.

* Reverted changes made to `docker-build` in Makefile.

* pass future where possible instead of bool (#121)

* first commit on Amanda's branch

* first

* before properties

* test not tested

* test works

* unit tests work, needs firewall rules

* addresses feedback

* erin's feedback

* janani's change, pass future

* async works much better now

* janani feedback

* screwed up interface prototype

* randomize the resources names used in tests (#152)

* Ability to Set SecretName When Creating Event Hub (#151)

* Updated eventhub_types - Added `secretName`.

* Added `secretName` to sample manifest.

* Set secret name to `secretName` if set, otherwise use eventhub name.

* Updated Makefile to update Azure Operator.

Also added the ability to rebuild image without cache.

* Updated README on how to update the Azure Operator.

* Updated CRD with SecretName description.

* Added tests to ensure `SecretName` was being used if present.

* Fix test.

* merging

* fixed issues with merge conflict
 Please enter the commit message for your changes. Lines starting

* fixing merge conflict markers in role yaml

* removing file
jananivMS added a commit that referenced this pull request Aug 30, 2019
* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

* need to handled unexpected error types...like validation.error (#111)

* refactor tests  (#90)

* improve tests with parallel execution and rm sleep

* fix the tests to run on kindcluster

* Updates to KV controller from Ace (#80) (#112)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>

* Test update (#115)

* this needs to exist in the reconciler in order to use controllerutil createorupdate

* Feat/add consumer group kind (#117)

* add consumer group kind

* update tests for consumer group

* fix isbeingdeleted

* Updates to README - steps for onboarding (#114)

* cluster additions

* updated docs

* Update azure-pipelines.yaml (#119)

* Update azure-pipelines.yaml

* fix tests (#140)

* revert back // +kubebuilder:subresource:status changes - fix broken tests

* Devcontainer to Help Onboard New People (#142)

* add dev conatiner - wip

* DevContainer up and running.

* Removed `sleep 80` and replaced with `kubectl wait`.

* Run `make set-kindcluster` from docker-compose.

* Set timeout on wait.

* Added `install-test-dependency` to makefile and dockerfile.

* Update README - Create SP with contribution rights.

* Updated README with details on using devcontainer.

* Stuff that wanted me to commit.

* Reverted changes made to `docker-build` in Makefile.

* pass future where possible instead of bool (#121)

* first commit on Amanda's branch

* first

* before properties

* test not tested

* test works

* unit tests work, needs firewall rules

* addresses feedback

* erin's feedback

* janani's change, pass future

* async works much better now

* janani feedback

* screwed up interface prototype

* randomize the resources names used in tests (#152)

* Ability to Set SecretName When Creating Event Hub (#151)

* Updated eventhub_types - Added `secretName`.

* Added `secretName` to sample manifest.

* Set secret name to `secretName` if set, otherwise use eventhub name.

* Updated Makefile to update Azure Operator.

Also added the ability to rebuild image without cache.

* Updated README on how to update the Azure Operator.

* Updated CRD with SecretName description.

* Added tests to ensure `SecretName` was being used if present.

* Fix test.

* merging

* fixed issues with merge conflict
 Please enter the commit message for your changes. Lines starting

* fixing merge conflict markers in role yaml

* removing file

* Fixed issues in the SDK library to take location from the spec instead of config  and the error library.
 Please enter the commit message for your changes. Lines starting
jananivMS added a commit that referenced this pull request Sep 3, 2019
* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

* need to handled unexpected error types...like validation.error (#111)

* refactor tests  (#90)

* improve tests with parallel execution and rm sleep

* fix the tests to run on kindcluster

* Updates to KV controller from Ace (#80) (#112)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>

* Test update (#115)

* this needs to exist in the reconciler in order to use controllerutil createorupdate

* Feat/add consumer group kind (#117)

* add consumer group kind

* update tests for consumer group

* fix isbeingdeleted

* Updates to README - steps for onboarding (#114)

* cluster additions

* updated docs

* Update azure-pipelines.yaml (#119)

* Update azure-pipelines.yaml

* fix tests (#140)

* revert back // +kubebuilder:subresource:status changes - fix broken tests

* Devcontainer to Help Onboard New People (#142)

* add dev conatiner - wip

* DevContainer up and running.

* Removed `sleep 80` and replaced with `kubectl wait`.

* Run `make set-kindcluster` from docker-compose.

* Set timeout on wait.

* Added `install-test-dependency` to makefile and dockerfile.

* Update README - Create SP with contribution rights.

* Updated README with details on using devcontainer.

* Stuff that wanted me to commit.

* Reverted changes made to `docker-build` in Makefile.

* pass future where possible instead of bool (#121)

* first commit on Amanda's branch

* first

* before properties

* test not tested

* test works

* unit tests work, needs firewall rules

* addresses feedback

* erin's feedback

* janani's change, pass future

* async works much better now

* janani feedback

* screwed up interface prototype

* randomize the resources names used in tests (#152)

* Ability to Set SecretName When Creating Event Hub (#151)

* Updated eventhub_types - Added `secretName`.

* Added `secretName` to sample manifest.

* Set secret name to `secretName` if set, otherwise use eventhub name.

* Updated Makefile to update Azure Operator.

Also added the ability to rebuild image without cache.

* Updated README on how to update the Azure Operator.

* Updated CRD with SecretName description.

* Added tests to ensure `SecretName` was being used if present.

* Fix test.

* Pr 22 merge (#158)

* kubebuilder init --domain azure --license none

* kubebuilder create api --group service --version v1alpha1 --kind Storage

* kubebuilder create api --group service --version v1alpha1 --kind CosmosDB

* Add MIT License

* Initial codes to support Azure Storage Account

* Add development docs

* Remove the storage account name from the spec

* Sync additional resources for Azure storage account

1. Create a secret based on storage account credentials
2. Add the global config

* Upgrade kubebuilder to 2.0.0-beta.0 and controller-runtime to v0.2.0-beta.4

* Copy pkg in Dockerfile

* Update controller-gen and make manifests

* Add prefix "Storage" for storage_types

* feature: add redis cache service

* Ignore the NotFound error when deleting resources

* Requeue the request if the deployment is not complete

* feature: add cosmosdb service

* Refine the logic of updating additional resources and output

* Deploy operator on a remote cluster

* add a sample app deployment yaml

* Generate assets for the templates

* Requeue after 30 seconds to avoid too many requests

Ignore the NotFound error when deleting cosmosdb

* Fix a bug of missing capacity of rediscache template

* fix: judge whether resources need to be updated
With adding generation in status, we can judge whether resources need to be updated.

Co-authored-by: Bin Xia <binxi@microsoft.com>

* Add docs to run the demo

* Update manager-role to operate secrets

Workaround: the rule should be appended. But I don't know how for now.
The workaround is to copy config/rbac/role.yaml and add the new rule.
Should be fixed in future.

* fix(Makefile): rename the target from "generate" to "generate-template" to avoid conflict

* Refactoring data focused operators.  Storage currently working though it needs cleanup

* Added deepcopy generated code

* CosmosDB deploy working

* Detailing current implementation of CosmosDB Create parameters

* Removing TestTags

* Redis cache now deploys

* Cleaned up code and removed references to v1alpha1

* Updating controllers logging calls

Co-authored-by: Chris Risner <github@chrisrisner.com>
Co-authored-by: Bin Xia <binxi@microsoft.com>

* Pr 22 merge (#158)

* kubebuilder init --domain azure --license none

* kubebuilder create api --group service --version v1alpha1 --kind Storage

* kubebuilder create api --group service --version v1alpha1 --kind CosmosDB

* Add MIT License

* Initial codes to support Azure Storage Account

* Add development docs

* Remove the storage account name from the spec

* Sync additional resources for Azure storage account

1. Create a secret based on storage account credentials
2. Add the global config

* Upgrade kubebuilder to 2.0.0-beta.0 and controller-runtime to v0.2.0-beta.4

* Copy pkg in Dockerfile

* Update controller-gen and make manifests

* Add prefix "Storage" for storage_types

* feature: add redis cache service

* Ignore the NotFound error when deleting resources

* Requeue the request if the deployment is not complete

* feature: add cosmosdb service

* Refine the logic of updating additional resources and output

* Deploy operator on a remote cluster

* add a sample app deployment yaml

* Generate assets for the templates

* Requeue after 30 seconds to avoid too many requests

Ignore the NotFound error when deleting cosmosdb

* Fix a bug of missing capacity of rediscache template

* fix: judge whether resources need to be updated
With adding generation in status, we can judge whether resources need to be updated.

Co-authored-by: Bin Xia <binxi@microsoft.com>

* Add docs to run the demo

* Update manager-role to operate secrets

Workaround: the rule should be appended. But I don't know how for now.
The workaround is to copy config/rbac/role.yaml and add the new rule.
Should be fixed in future.

* fix(Makefile): rename the target from "generate" to "generate-template" to avoid conflict

* Refactoring data focused operators.  Storage currently working though it needs cleanup

* Added deepcopy generated code

* CosmosDB deploy working

* Detailing current implementation of CosmosDB Create parameters

* Removing TestTags

* Redis cache now deploys

* Cleaned up code and removed references to v1alpha1

* Updating controllers logging calls

Co-authored-by: Chris Risner <github@chrisrisner.com>
Co-authored-by: Bin Xia <binxi@microsoft.com>

* Pr 22 merge (#158) (#165)

* kubebuilder init --domain azure --license none

* kubebuilder create api --group service --version v1alpha1 --kind Storage

* kubebuilder create api --group service --version v1alpha1 --kind CosmosDB

* Add MIT License

* Initial codes to support Azure Storage Account

* Add development docs

* Remove the storage account name from the spec

* Sync additional resources for Azure storage account

1. Create a secret based on storage account credentials
2. Add the global config

* Upgrade kubebuilder to 2.0.0-beta.0 and controller-runtime to v0.2.0-beta.4

* Copy pkg in Dockerfile

* Update controller-gen and make manifests

* Add prefix "Storage" for storage_types

* feature: add redis cache service

* Ignore the NotFound error when deleting resources

* Requeue the request if the deployment is not complete

* feature: add cosmosdb service

* Refine the logic of updating additional resources and output

* Deploy operator on a remote cluster

* add a sample app deployment yaml

* Generate assets for the templates

* Requeue after 30 seconds to avoid too many requests

Ignore the NotFound error when deleting cosmosdb

* Fix a bug of missing capacity of rediscache template

* fix: judge whether resources need to be updated
With adding generation in status, we can judge whether resources need to be updated.

Co-authored-by: Bin Xia <binxi@microsoft.com>

* Add docs to run the demo

* Update manager-role to operate secrets

Workaround: the rule should be appended. But I don't know how for now.
The workaround is to copy config/rbac/role.yaml and add the new rule.
Should be fixed in future.

* fix(Makefile): rename the target from "generate" to "generate-template" to avoid conflict

* Refactoring data focused operators.  Storage currently working though it needs cleanup

* Added deepcopy generated code

* CosmosDB deploy working

* Detailing current implementation of CosmosDB Create parameters

* Removing TestTags

* Redis cache now deploys

* Cleaned up code and removed references to v1alpha1

* Updating controllers logging calls

Co-authored-by: Chris Risner <github@chrisrisner.com>
Co-authored-by: Bin Xia <binxi@microsoft.com>

* Capture EventHub to Azure Blob Storage Container (#146)

* added eventhub with and without capture
* create, delete and get properties for storage manager
* capture eventhub tests
* added storage tests to make tests
* configured location to default set by environment variable
* synchronised test setup and teardown
* incorporated storages module
* fixed setup and teardown of storage tests
* fixed storage container tests

* Camelcase EventHub (#176)

* Removed ports from docker-compose.

* Updated CRD - camelcase over lowercase.

* Updated example manifests.

* Role thing.

* Camelcase new changes to EventHub types.

* Camelcase example.

* Removed old file.

* Fixing issues #173 and #174 (#175)

* Updated controllers to use `azure.microsoft.com` over `service.azure`.

* Updated webhooks to point to `azure.microsoft.com`.

* Updated caninject to point to `azure.microsoft.com`.

* Regenerated role.yaml.

* Point kustomization.yaml in CRD to right base CRDs.

* Updated demo.

* Role update.

* Update group from service to azure in PROJECT.

* Increased Partition Count Minimum in EventHub to 2 (#178)

* Increase minimum partition count to 2.

* Updated the CRD.

* Updated eventhub example.

* Changed resource group example.

* Increased test partition count to 2.

* Updated tests.
jananivMS added a commit that referenced this pull request Sep 4, 2019
…ver (#184)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

* need to handled unexpected error types...like validation.error (#111)

* refactor tests  (#90)

* improve tests with parallel execution and rm sleep

* fix the tests to run on kindcluster

* Updates to KV controller from Ace (#80) (#112)

* feat: implement keyvault controller

* Ace's KV changes with updates

* Added an event for the final successful provisioning

* Updated changes based on the PR comments

* removing unwanted file

* making resource group name the one in the keyvault yaml

Co-authored-by: Ace Eldeib <alexeldeib@gmail.com>

* Test update (#115)

* this needs to exist in the reconciler in order to use controllerutil createorupdate

* Feat/add consumer group kind (#117)

* add consumer group kind

* update tests for consumer group

* fix isbeingdeleted

* Updates to README - steps for onboarding (#114)

* cluster additions

* updated docs

* Update azure-pipelines.yaml (#119)

* Update azure-pipelines.yaml

* fix tests (#140)

* revert back // +kubebuilder:subresource:status changes - fix broken tests

* Devcontainer to Help Onboard New People (#142)

* add dev conatiner - wip

* DevContainer up and running.

* Removed `sleep 80` and replaced with `kubectl wait`.

* Run `make set-kindcluster` from docker-compose.

* Set timeout on wait.

* Added `install-test-dependency` to makefile and dockerfile.

* Update README - Create SP with contribution rights.

* Updated README with details on using devcontainer.

* Stuff that wanted me to commit.

* Reverted changes made to `docker-build` in Makefile.

* pass future where possible instead of bool (#121)

* first commit on Amanda's branch

* first

* before properties

* test not tested

* test works

* unit tests work, needs firewall rules

* addresses feedback

* erin's feedback

* janani's change, pass future

* async works much better now

* janani feedback

* screwed up interface prototype

* randomize the resources names used in tests (#152)

* Ability to Set SecretName When Creating Event Hub (#151)

* Updated eventhub_types - Added `secretName`.

* Added `secretName` to sample manifest.

* Set secret name to `secretName` if set, otherwise use eventhub name.

* Updated Makefile to update Azure Operator.

Also added the ability to rebuild image without cache.

* Updated README on how to update the Azure Operator.

* Updated CRD with SecretName description.

* Added tests to ensure `SecretName` was being used if present.

* Fix test.

* Pr 22 merge (#158)

* kubebuilder init --domain azure --license none

* kubebuilder create api --group service --version v1alpha1 --kind Storage

* kubebuilder create api --group service --version v1alpha1 --kind CosmosDB

* Add MIT License

* Initial codes to support Azure Storage Account

* Add development docs

* Remove the storage account name from the spec

* Sync additional resources for Azure storage account

1. Create a secret based on storage account credentials
2. Add the global config

* Upgrade kubebuilder to 2.0.0-beta.0 and controller-runtime to v0.2.0-beta.4

* Copy pkg in Dockerfile

* Update controller-gen and make manifests

* Add prefix "Storage" for storage_types

* feature: add redis cache service

* Ignore the NotFound error when deleting resources

* Requeue the request if the deployment is not complete

* feature: add cosmosdb service

* Refine the logic of updating additional resources and output

* Deploy operator on a remote cluster

* add a sample app deployment yaml

* Generate assets for the templates

* Requeue after 30 seconds to avoid too many requests

Ignore the NotFound error when deleting cosmosdb

* Fix a bug of missing capacity of rediscache template

* fix: judge whether resources need to be updated
With adding generation in status, we can judge whether resources need to be updated.

Co-authored-by: Bin Xia <binxi@microsoft.com>

* Add docs to run the demo

* Update manager-role to operate secrets

Workaround: the rule should be appended. But I don't know how for now.
The workaround is to copy config/rbac/role.yaml and add the new rule.
Should be fixed in future.

* fix(Makefile): rename the target from "generate" to "generate-template" to avoid conflict

* Refactoring data focused operators.  Storage currently working though it needs cleanup

* Added deepcopy generated code

* CosmosDB deploy working

* Detailing current implementation of CosmosDB Create parameters

* Removing TestTags

* Redis cache now deploys

* Cleaned up code and removed references to v1alpha1

* Updating controllers logging calls

Co-authored-by: Chris Risner <github@chrisrisner.com>
Co-authored-by: Bin Xia <binxi@microsoft.com>

* Pr 22 merge (#158)

* kubebuilder init --domain azure --license none

* kubebuilder create api --group service --version v1alpha1 --kind Storage

* kubebuilder create api --group service --version v1alpha1 --kind CosmosDB

* Add MIT License

* Initial codes to support Azure Storage Account

* Add development docs

* Remove the storage account name from the spec

* Sync additional resources for Azure storage account

1. Create a secret based on storage account credentials
2. Add the global config

* Upgrade kubebuilder to 2.0.0-beta.0 and controller-runtime to v0.2.0-beta.4

* Copy pkg in Dockerfile

* Update controller-gen and make manifests

* Add prefix "Storage" for storage_types

* feature: add redis cache service

* Ignore the NotFound error when deleting resources

* Requeue the request if the deployment is not complete

* feature: add cosmosdb service

* Refine the logic of updating additional resources and output

* Deploy operator on a remote cluster

* add a sample app deployment yaml

* Generate assets for the templates

* Requeue after 30 seconds to avoid too many requests

Ignore the NotFound error when deleting cosmosdb

* Fix a bug of missing capacity of rediscache template

* fix: judge whether resources need to be updated
With adding generation in status, we can judge whether resources need to be updated.

Co-authored-by: Bin Xia <binxi@microsoft.com>

* Add docs to run the demo

* Update manager-role to operate secrets

Workaround: the rule should be appended. But I don't know how for now.
The workaround is to copy config/rbac/role.yaml and add the new rule.
Should be fixed in future.

* fix(Makefile): rename the target from "generate" to "generate-template" to avoid conflict

* Refactoring data focused operators.  Storage currently working though it needs cleanup

* Added deepcopy generated code

* CosmosDB deploy working

* Detailing current implementation of CosmosDB Create parameters

* Removing TestTags

* Redis cache now deploys

* Cleaned up code and removed references to v1alpha1

* Updating controllers logging calls

Co-authored-by: Chris Risner <github@chrisrisner.com>
Co-authored-by: Bin Xia <binxi@microsoft.com>

* Pr 22 merge (#158) (#165)

* kubebuilder init --domain azure --license none

* kubebuilder create api --group service --version v1alpha1 --kind Storage

* kubebuilder create api --group service --version v1alpha1 --kind CosmosDB

* Add MIT License

* Initial codes to support Azure Storage Account

* Add development docs

* Remove the storage account name from the spec

* Sync additional resources for Azure storage account

1. Create a secret based on storage account credentials
2. Add the global config

* Upgrade kubebuilder to 2.0.0-beta.0 and controller-runtime to v0.2.0-beta.4

* Copy pkg in Dockerfile

* Update controller-gen and make manifests

* Add prefix "Storage" for storage_types

* feature: add redis cache service

* Ignore the NotFound error when deleting resources

* Requeue the request if the deployment is not complete

* feature: add cosmosdb service

* Refine the logic of updating additional resources and output

* Deploy operator on a remote cluster

* add a sample app deployment yaml

* Generate assets for the templates

* Requeue after 30 seconds to avoid too many requests

Ignore the NotFound error when deleting cosmosdb

* Fix a bug of missing capacity of rediscache template

* fix: judge whether resources need to be updated
With adding generation in status, we can judge whether resources need to be updated.

Co-authored-by: Bin Xia <binxi@microsoft.com>

* Add docs to run the demo

* Update manager-role to operate secrets

Workaround: the rule should be appended. But I don't know how for now.
The workaround is to copy config/rbac/role.yaml and add the new rule.
Should be fixed in future.

* fix(Makefile): rename the target from "generate" to "generate-template" to avoid conflict

* Refactoring data focused operators.  Storage currently working though it needs cleanup

* Added deepcopy generated code

* CosmosDB deploy working

* Detailing current implementation of CosmosDB Create parameters

* Removing TestTags

* Redis cache now deploys

* Cleaned up code and removed references to v1alpha1

* Updating controllers logging calls

Co-authored-by: Chris Risner <github@chrisrisner.com>
Co-authored-by: Bin Xia <binxi@microsoft.com>

* Capture EventHub to Azure Blob Storage Container (#146)

* added eventhub with and without capture
* create, delete and get properties for storage manager
* capture eventhub tests
* added storage tests to make tests
* configured location to default set by environment variable
* synchronised test setup and teardown
* incorporated storages module
* fixed setup and teardown of storage tests
* fixed storage container tests

* Camelcase EventHub (#176)

* Removed ports from docker-compose.

* Updated CRD - camelcase over lowercase.

* Updated example manifests.

* Role thing.

* Camelcase new changes to EventHub types.

* Camelcase example.

* Removed old file.

* Fixing issues #173 and #174 (#175)

* Updated controllers to use `azure.microsoft.com` over `service.azure`.

* Updated webhooks to point to `azure.microsoft.com`.

* Updated caninject to point to `azure.microsoft.com`.

* Regenerated role.yaml.

* Point kustomization.yaml in CRD to right base CRDs.

* Updated demo.

* Role update.

* Update group from service to azure in PROJECT.

* Increased Partition Count Minimum in EventHub to 2 (#178)

* Increase minimum partition count to 2.

* Updated the CRD.

* Updated eventhub example.

* Changed resource group example.

* Increased test partition count to 2.

* Updated tests.

* Changes to wire Sql firewall in the controller

* Addressed PR comments
Porges pushed a commit that referenced this pull request May 11, 2021
* Add function definition

  - Update definition to be more generic so that it
    could apply to types or functions

* Make PackageReference work for local and non-local

  - Removed PackageReference from PackageDefinition, since a reference
    can be to an arbitrary package but a definition is clearly based in
    local source.
  - PackageReference now supports arbitrary package references

* Fix formatting
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants