Change test organization for shared tests. #7227

vinayada1 · 2024-03-01T22:30:11Z

Description

Change test organization for shared tests. These tests are now organized under the corerp directory.
Separate cloud/non-cloud tests
Organize the corerp tests as per test organization proposal design-notes#35. There will be more PRs that will follow to re-org the other tests.

Type of change

This pull request adds or changes features of Radius and has an approved issue (Separate out functional tests that require cloud/external resources #6588 ).

Fixes: Fixes part of #6588. This is a part of a multi-PR fix

radius-functional-tests · 2024-03-01T22:40:23Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`465e4a8`
Unique ID	2438d31626
Image tag	pr-2438d31626

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-2438d31626
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-2438d31626
controller test image location: ghcr.io/radius-project/dev/controller:pr-2438d31626
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-2438d31626
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting msgrp functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting shared functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting samples functional tests...
⌛ Starting ucp functional tests...
❌ shared functional test failed. Please check the logs for more details
❌ datastoresrp functional test failed. Please check the logs for more details
❌ daprrp functional test failed. Please check the logs for more details
❌ samples functional test cancelled. Please check the logs for more details
❌ kubernetes functional test cancelled. Please check the logs for more details
❌ ucp functional test cancelled. Please check the logs for more details

radius-functional-tests · 2024-03-01T22:56:25Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`e9d422c`
Unique ID	2eae1c321a
Image tag	pr-2eae1c321a

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-2eae1c321a
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-2eae1c321a
controller test image location: ghcr.io/radius-project/dev/controller:pr-2eae1c321a
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-2eae1c321a
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting shared functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting samples functional tests...
⌛ Starting ucp functional tests...
❌ samples functional test failed. Please check the logs for more details
❌ kubernetes functional test failed. Please check the logs for more details
❌ daprrp functional test cancelled. Please check the logs for more details
❌ shared functional test cancelled. Please check the logs for more details
❌ datastoresrp functional test cancelled. Please check the logs for more details
❌ ucp functional test cancelled. Please check the logs for more details
❌ msgrp functional test cancelled. Please check the logs for more details

radius-functional-tests · 2024-03-02T00:20:39Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`19c2fcc`
Unique ID	c532d0bc37
Image tag	pr-c532d0bc37

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-c532d0bc37
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-c532d0bc37
controller test image location: ghcr.io/radius-project/dev/controller:pr-c532d0bc37
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-c532d0bc37
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting samples functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting shared functional tests...
⌛ Starting datastoresrp functional tests...
❌ shared functional test failed. Please check the logs for more details
❌ msgrp functional test cancelled. Please check the logs for more details
❌ datastoresrp functional test cancelled. Please check the logs for more details
❌ daprrp functional test cancelled. Please check the logs for more details
❌ ucp functional test cancelled. Please check the logs for more details

radius-functional-tests · 2024-03-02T00:43:12Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`d0afa45`
Unique ID	36b1c07904
Image tag	pr-36b1c07904

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-36b1c07904
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-36b1c07904
controller test image location: ghcr.io/radius-project/dev/controller:pr-36b1c07904
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-36b1c07904
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting samples functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting shared functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting ucp functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting kubernetes functional tests...
❌ shared functional test failed. Please check the logs for more details
❌ ucp functional test cancelled. Please check the logs for more details
❌ daprrp functional test cancelled. Please check the logs for more details
❌ kubernetes functional test cancelled. Please check the logs for more details
❌ datastoresrp functional test cancelled. Please check the logs for more details

radius-functional-tests · 2024-03-02T01:26:05Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`6b275c5`
Unique ID	458d866a50
Image tag	pr-458d866a50

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-458d866a50
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-458d866a50
controller test image location: ghcr.io/radius-project/dev/controller:pr-458d866a50
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-458d866a50
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting samples functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting shared functional tests...
✅ kubernetes functional tests succeeded
✅ msgrp functional tests succeeded
✅ ucp functional tests succeeded
✅ samples functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ daprrp functional tests succeeded
❌ shared functional test failed. Please check the logs for more details

.github/workflows/functional-test.yaml

build/recipes.mk

build/test.mk

test/functional-portable/corerp/cloud/mechanics/aws_mechanics_test.go

test/functional-portable/corerp/cloud/resources/persistent_volume_test.go

...ortable/corerp/cloud/resources/testdata/recipes/test-terraform-recipes/azure-storage/main.tf

test/functional-portable/corerp/noncloud/cli/cli_test.go

rynowak

The code changes here look like what I expected for moving/separated tests.

However, there's some things I'd like to know the answers to before we merge:

I'd like to figure out a plan for mis-categorized or badly-designed tests. This might look like, diffing the set of tests we actually have against the set of tests we want to have, and then filing bugs for follow-up.
I'd like to talk about how we're going to clean up references to shared code (like RPTest).
I'd like to talk about how we're going to organize recipes.

It's good if the assets (like bicep or tf files) used in each test can be isolated and self-contained. Right now the references to recipes are kinda all over. I know you didn't make this mess, but we shouldn't miss the opportunity to clean it up 😎

/cc @youngbupark @kachawla

radius-functional-tests · 2024-03-05T19:03:33Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`8f6d92f`
Unique ID	453f7d1fd6
Image tag	pr-453f7d1fd6

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-453f7d1fd6
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-453f7d1fd6
controller test image location: ghcr.io/radius-project/dev/controller:pr-453f7d1fd6
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-453f7d1fd6
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
❌ Container images build failed
❌ Test recipe publishing failed

radius-functional-tests · 2024-03-05T19:32:05Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`4d36eb5`
Unique ID	a037e3f0c8
Image tag	pr-a037e3f0c8

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-a037e3f0c8
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-a037e3f0c8
controller test image location: ghcr.io/radius-project/dev/controller:pr-a037e3f0c8
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-a037e3f0c8
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting msgrp functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting samples functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting ucp functional tests...
⌛ Starting shared functional tests...
✅ msgrp functional tests succeeded
✅ samples functional tests succeeded
✅ kubernetes functional tests succeeded
✅ ucp functional tests succeeded
❌ datastoresrp functional test failed. Please check the logs for more details
❌ daprrp functional test cancelled. Please check the logs for more details

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

radius-functional-tests · 2024-03-22T19:37:03Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`24c3e2f`
Unique ID	e05641e102
Image tag	pr-e05641e102

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-e05641e102
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-e05641e102
controller test image location: ghcr.io/radius-project/dev/controller:pr-e05641e102
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-e05641e102
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting samples functional tests...
⌛ Starting shared functional tests...
⌛ Starting cli functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting datastoresrp functional tests...
❌ msgrp functional test failed. Please check the logs for more details
❌ samples functional test cancelled. Please check the logs for more details
❌ datastoresrp functional test cancelled. Please check the logs for more details
❌ daprrp functional test cancelled. Please check the logs for more details
❌ cli functional test cancelled. Please check the logs for more details
❌ shared functional test cancelled. Please check the logs for more details

youngbupark · 2024-03-25T17:56:08Z

long-running test is failed because it cannot get the secret to log in azure. it is expected.

radius-functional-tests · 2024-03-26T18:07:06Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`100f08e`
Unique ID	funcbf39416577
Image tag	pr-funcbf39416577

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-funcbf39416577
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-funcbf39416577
controller test image location: ghcr.io/radius-project/dev/controller:pr-funcbf39416577
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-funcbf39416577
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting cli functional tests...
⌛ Starting samples functional tests...
⌛ Starting shared functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting kubernetes functional tests...
✅ ucp functional tests succeeded
✅ samples functional tests succeeded
✅ msgrp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ daprrp functional tests succeeded
❌ cli functional test failed. Please check the logs for more details
❌ datastoresrp functional test cancelled. Please check the logs for more details
❌ shared functional test cancelled. Please check the logs for more details

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

radius-functional-tests · 2024-03-26T20:40:51Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`b1fca53`
Unique ID	func1ea887761c
Image tag	pr-func1ea887761c

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-func1ea887761c
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func1ea887761c
controller test image location: ghcr.io/radius-project/dev/controller:pr-func1ea887761c
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func1ea887761c
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting msgrp functional tests...
⌛ Starting ucp functional tests...
⌛ Starting samples functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting shared functional tests...
⌛ Starting cli functional tests...
⌛ Starting datastoresrp functional tests...
✅ msgrp functional tests succeeded
✅ samples functional tests succeeded
✅ kubernetes functional tests succeeded
✅ ucp functional tests succeeded
✅ daprrp functional tests succeeded
✅ datastoresrp functional tests succeeded
❌ cli functional test failed. Please check the logs for more details
❌ shared functional test cancelled. Please check the logs for more details

radius-functional-tests · 2024-03-26T20:41:25Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`9b94286`
Unique ID	funcc4962517a2
Image tag	pr-funcc4962517a2

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-funcc4962517a2
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-funcc4962517a2
controller test image location: ghcr.io/radius-project/dev/controller:pr-funcc4962517a2
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-funcc4962517a2
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting datastoresrp functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting samples functional tests...
⌛ Starting shared functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting ucp functional tests...
⌛ Starting cli functional tests...
✅ samples functional tests succeeded
✅ kubernetes functional tests succeeded
✅ msgrp functional tests succeeded
✅ daprrp functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ ucp functional tests succeeded
❌ cli functional test failed. Please check the logs for more details
❌ shared functional test cancelled. Please check the logs for more details

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

radius-functional-tests · 2024-03-26T21:18:28Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`5b2d1aa`
Unique ID	func31ffff0f9d
Image tag	pr-func31ffff0f9d

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-func31ffff0f9d
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func31ffff0f9d
controller test image location: ghcr.io/radius-project/dev/controller:pr-func31ffff0f9d
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func31ffff0f9d
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting kubernetes functional tests...
⌛ Starting datastoresrp functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting msgrp functional tests...
⌛ Starting cli functional tests...
⌛ Starting ucp functional tests...
⌛ Starting shared functional tests...
⌛ Starting samples functional tests...
✅ kubernetes functional tests succeeded
✅ msgrp functional tests succeeded
✅ samples functional tests succeeded
✅ ucp functional tests succeeded
✅ daprrp functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ cli functional tests succeeded
✅ shared functional tests succeeded

rynowak · 2024-03-26T21:48:44Z

build/test.mk

-test-functional-shared: ## Runs shared functional tests
-	CGO_ENABLED=1 $(GOTEST_TOOL) ./test/functional/shared/... -timeout ${TEST_TIMEOUT} -v -parallel 10 $(GOTEST_OPTS)
+test-functional-shared: test-functional-corerp-noncloud test-functional-corerp-cloud ## Runs all Core RP functional tests (both cloud and non-cloud)
+	@echo "$(ARROW) Running corerp functional tests"


Is this supposed to be blank? If this is here for historical purposes, when can it be removed?

You mean it should be test-functional-corerp instead of test-functional-shared? This PR will still run against the old workflow in the main branch which uses "shared" instead of "corerp". I will change the workflow in a separate PR once the "corerp" directory structure is checked in

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

radius-functional-tests · 2024-03-26T22:25:47Z

Radius functional test overview

🔍 Go to test action run

Name	Value
Repository	test-org-admin/radius-main
Commit ref	`8daf0b9`
Unique ID	func4485c5c016
Image tag	pr-func4485c5c016

Click here to see the list of tools in the current test run

gotestsum 1.10.0
KinD: v0.20.0
Dapr: 1.12.0
Azure KeyVault CSI driver: 1.4.2
Azure Workload identity webhook: 1.1.0
Bicep recipe location ghcr.io/radius-project/dev/test/functional/shared/recipes/<name>:pr-func4485c5c016
Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func4485c5c016
controller test image location: ghcr.io/radius-project/dev/controller:pr-func4485c5c016
ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func4485c5c016
deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting shared functional tests...
⌛ Starting ucp functional tests...
⌛ Starting daprrp functional tests...
⌛ Starting kubernetes functional tests...
⌛ Starting cli functional tests...
⌛ Starting datastoresrp functional tests...
✅ ucp functional tests succeeded
✅ kubernetes functional tests succeeded
✅ msgrp functional tests succeeded
✅ samples functional tests succeeded
✅ daprrp functional tests succeeded
✅ datastoresrp functional tests succeeded
✅ cli functional tests succeeded
✅ shared functional tests succeeded

vinayada1 requested review from a team as code owners March 1, 2024 22:30

vinayada1 force-pushed the test-org-new-corerp branch from c396bb0 to 465e4a8 Compare March 1, 2024 22:38

vinayada1 temporarily deployed to functional-tests March 1, 2024 22:39 — with GitHub Actions Inactive

vinayada1 force-pushed the test-org-new-corerp branch from 465e4a8 to e9d422c Compare March 1, 2024 22:55

vinayada1 temporarily deployed to functional-tests March 1, 2024 22:55 — with GitHub Actions Inactive

vinayada1 force-pushed the test-org-new-corerp branch from e9d422c to 19c2fcc Compare March 2, 2024 00:19

vinayada1 temporarily deployed to functional-tests March 2, 2024 00:20 — with GitHub Actions Inactive

vinayada1 force-pushed the test-org-new-corerp branch from 19c2fcc to d0afa45 Compare March 2, 2024 00:42

vinayada1 temporarily deployed to functional-tests March 2, 2024 00:42 — with GitHub Actions Inactive

vinayada1 temporarily deployed to functional-tests March 2, 2024 01:25 — with GitHub Actions Inactive

rynowak reviewed Mar 3, 2024

View reviewed changes

.github/workflows/functional-test.yaml Outdated Show resolved Hide resolved

rynowak reviewed Mar 3, 2024

View reviewed changes

build/recipes.mk Outdated Show resolved Hide resolved

rynowak reviewed Mar 3, 2024

View reviewed changes

build/test.mk Outdated Show resolved Hide resolved

rynowak reviewed Mar 3, 2024

View reviewed changes

test/functional-portable/corerp/cloud/mechanics/aws_mechanics_test.go Outdated Show resolved Hide resolved

rynowak reviewed Mar 3, 2024

View reviewed changes

test/functional-portable/corerp/cloud/resources/persistent_volume_test.go Outdated Show resolved Hide resolved

rynowak reviewed Mar 3, 2024

View reviewed changes

...ortable/corerp/cloud/resources/testdata/recipes/test-terraform-recipes/azure-storage/main.tf Outdated Show resolved Hide resolved

rynowak reviewed Mar 3, 2024

View reviewed changes

test/functional-portable/corerp/noncloud/cli/cli_test.go Outdated Show resolved Hide resolved

rynowak reviewed Mar 3, 2024

View reviewed changes

vinayada1 force-pushed the test-org-new-corerp branch from 6b275c5 to 8f6d92f Compare March 5, 2024 19:02

vinayada1 temporarily deployed to functional-tests March 5, 2024 19:02 — with GitHub Actions Inactive

vinayada1 temporarily deployed to functional-tests March 5, 2024 19:31 — with GitHub Actions Inactive

vinayada1 force-pushed the test-org-new-corerp branch from 4d36eb5 to 0be3e1c Compare March 5, 2024 19:36

vinayada1 added 6 commits March 22, 2024 12:31

fix comments

be1b4ee

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

fix build

498b812

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

fix test issues

f5e1b40

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

fix file not found

a77cdcd

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

Move all test recipes to a common folder

9b3ec42

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

Move redis-selfhost modules

24c3e2f

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

vinayada1 force-pushed the test-org-new-corerp branch from 31560d0 to 24c3e2f Compare March 22, 2024 19:31

vinayada1 temporarily deployed to functional-tests March 22, 2024 19:36 — with GitHub Actions Inactive

Try change to recipes.mk

100f08e

vinayada1 temporarily deployed to functional-tests March 26, 2024 18:06 — with GitHub Actions Inactive

Fix recipe path in cli_test

b1fca53

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

vinayada1 temporarily deployed to functional-tests March 26, 2024 20:40 — with GitHub Actions Inactive

Merge branch 'main' into test-org-new-corerp

9b94286

vinayada1 temporarily deployed to functional-tests March 26, 2024 20:40 — with GitHub Actions Inactive

Fix recipe path in cli_test

5b2d1aa

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

vinayada1 temporarily deployed to functional-tests March 26, 2024 21:17 — with GitHub Actions Inactive

rynowak reviewed Mar 26, 2024

View reviewed changes

rynowak previously approved these changes Mar 26, 2024

View reviewed changes

fix comments

8daf0b9

Signed-off-by: vinayada1 <28875764+vinayada1@users.noreply.github.com>

vinayada1 dismissed rynowak’s stale review via 8daf0b9 March 26, 2024 22:24

vinayada1 temporarily deployed to functional-tests March 26, 2024 22:25 — with GitHub Actions Inactive

rynowak approved these changes Mar 26, 2024

View reviewed changes

vinayada1 merged commit dc8e1b2 into radius-project:main Mar 26, 2024
18 of 19 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Change test organization for shared tests. #7227

Change test organization for shared tests. #7227

vinayada1 commented Mar 1, 2024

radius-functional-tests bot commented Mar 1, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 1, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 2, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 2, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 2, 2024 •

edited

Loading

rynowak left a comment •

edited

Loading

radius-functional-tests bot commented Mar 5, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 5, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 22, 2024 •

edited

Loading

youngbupark commented Mar 25, 2024

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

rynowak Mar 26, 2024

vinayada1 Mar 26, 2024

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

Change test organization for shared tests. #7227

Change test organization for shared tests. #7227

Conversation

vinayada1 commented Mar 1, 2024

Description

Type of change

radius-functional-tests bot commented Mar 1, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 1, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 2, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 2, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 2, 2024 • edited Loading

Radius functional test overview

Test Status

rynowak left a comment • edited Loading

Choose a reason for hiding this comment

radius-functional-tests bot commented Mar 5, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 5, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 22, 2024 • edited Loading

Radius functional test overview

Test Status

youngbupark commented Mar 25, 2024

radius-functional-tests bot commented Mar 26, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 26, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 26, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 26, 2024 • edited Loading

Radius functional test overview

Test Status

rynowak Mar 26, 2024

Choose a reason for hiding this comment

vinayada1 Mar 26, 2024

Choose a reason for hiding this comment

radius-functional-tests bot commented Mar 26, 2024 • edited Loading

Radius functional test overview

Test Status

radius-functional-tests bot commented Mar 1, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 1, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 2, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 2, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 2, 2024 •

edited

Loading

rynowak left a comment •

edited

Loading

radius-functional-tests bot commented Mar 5, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 5, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 22, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading

radius-functional-tests bot commented Mar 26, 2024 •

edited

Loading