Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cloud/azure: TestAzureStorageFileImplicitAuth failed #107137

Closed
cockroach-teamcity opened this issue Jul 19, 2023 · 0 comments · Fixed by #107205
Closed

cloud/azure: TestAzureStorageFileImplicitAuth failed #107137

cockroach-teamcity opened this issue Jul 19, 2023 · 0 comments · Fixed by #107205
Assignees
Labels
branch-master Failures on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-disaster-recovery
Milestone

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Jul 19, 2023

cloud/azure.TestAzureStorageFileImplicitAuth failed with artifacts on master @ 06b5ba7888339ed53477ff73f9f3ae77a708ee17:

        	            	Wraps: (2) GET https://backupfixtures.blob.core.windows.net/nightlies/backup-test/testing-123
        	            	  | --------------------------------------------------------------------------------
        	            	  | RESPONSE 404: 404 The specified blob does not exist.
        	            	  | ERROR CODE: BlobNotFound
        	            	  | --------------------------------------------------------------------------------
        	            	  | <?xml version="1.0" encoding="utf-8"?><Error><Code>BlobNotFound</Code><Message>The specified blob does not exist.
        	            	  | RequestId:cac4fc26-c01e-0061-4ed4-b98f7e000000
        	            	  | Time:2023-07-19T00:05:11.9520279Z</Message></Error>
        	            	  | --------------------------------------------------------------------------------
        	            	Wraps: (3) attached stack trace
        	            	  -- stack trace:
        	            	  | github.com/cockroachdb/cockroach/pkg/cloud/azure.(*azureStorage).ReadFile
        	            	  | 	github.com/cockroachdb/cockroach/pkg/cloud/azure/azure_storage.go:337
        	            	  | github.com/cockroachdb/cockroach/pkg/cloud.(*esWrapper).ReadFile
        	            	  | 	github.com/cockroachdb/cockroach/pkg/cloud/impl_registry.go:333
        	            	  | github.com/cockroachdb/cockroach/pkg/cloud/cloudtestutils.CheckExportStore.func2.1.1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/cloud/cloudtestutils/cloud_test_helpers.go:225
        	            	  | [...repeated from below...]
        	            	Wraps: (4) azure blob does not exist
        	            	Wraps: (5) attached stack trace
        	            	  -- stack trace:
        	            	  | github.com/cockroachdb/cockroach/pkg/cloud.init
        	            	  | 	github.com/cockroachdb/cockroach/pkg/cloud/external_storage.go:131
        	            	  | runtime.doInit
        	            	  | 	GOROOT/src/runtime/proc.go:6349
        	            	  | runtime.doInit
        	            	  | 	GOROOT/src/runtime/proc.go:6326
        	            	  | runtime.doInit
        	            	  | 	GOROOT/src/runtime/proc.go:6326
        	            	  | runtime.doInit
        	            	  | 	GOROOT/src/runtime/proc.go:6326
        	            	  | runtime.main
        	            	  | 	GOROOT/src/runtime/proc.go:233
        	            	  | runtime.goexit
        	            	  | 	GOROOT/src/runtime/asm_amd64.s:1594
        	            	Wraps: (6) external_storage: file doesn't exist
        	            	Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.leafError
        	Test:       	TestAzureStorageFileImplicitAuth/exceeds-4mb-chunk/rand-readats/#08
            --- FAIL: TestAzureStorageFileImplicitAuth/exceeds-4mb-chunk/rand-readats/#08 (0.01s)
=== RUN   TestAzureStorageFileImplicitAuth/read-single-file-by-uri
    cloud_test_helpers.go:262: GET https://backupfixtures.blob.core.windows.net/nightlies/backup-test/A
        --------------------------------------------------------------------------------
        RESPONSE 404: 404 The specified blob does not exist.
        ERROR CODE: BlobNotFound
        --------------------------------------------------------------------------------
        <?xml version="1.0" encoding="utf-8"?><Error><Code>BlobNotFound</Code><Message>The specified blob does not exist.
        RequestId:cac4fd9a-c01e-0061-77d4-b98f7e000000
        Time:2023-07-19T00:05:12.2228410Z</Message></Error>
        --------------------------------------------------------------------------------: azure blob does not exist: external_storage: file doesn't exist
    --- FAIL: TestAzureStorageFileImplicitAuth/read-single-file-by-uri (0.25s)
Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-29907

@cockroach-teamcity cockroach-teamcity added branch-master Failures on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-disaster-recovery labels Jul 19, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.2 milestone Jul 19, 2023
craig bot pushed a commit that referenced this issue Jul 21, 2023
106668: plpgsql: implement tail-call optimization for PLpgSQL routines r=DrewKimball a=DrewKimball

This patch implements tail-call optimization for the nested routine execution that is used to handle PLpgSQL control flow. PLpgSQL sub-routines are always tail calls because they are built as "continuation" functions, so we can always use the optimization for PLpgSQL. Tail-call optimization is only possible if the plan is not distributed (although we may not currently distribute such plans anyway).

The optimization is performed by setting a `deferredRoutineReceiver` field on the planner before planning and running a nested routine. This `deferredRoutineReceiver` allows a routine in tail-call position to send the information needed to evaluate itself to its parent, and then return NULL. Once the parent routine receives the result, it checks whether `deferredRoutineReceiver` received a deferred nested routine, and if so, evaluates it to obtain the actual result.

Given a simple looping function like the following:
```
CREATE FUNCTION f(n INT) RETURNS INT AS $$
  DECLARE
    i INT := 0;
  BEGIN
    LOOP
      IF i >= n THEN
        EXIT;
      END IF;
      i := i + 1;
    END LOOP;
    RETURN i;
  END
$$ LANGUAGE PLpgSQL;
```
This optimization takes runtime on my machine for `n=100000` from >20m to ~2s.

Informs #105254

Release note: None

107205: cloud: allow parallel running of cloud unit tests r=rhu713 a=rhu713

Append a random uint64 in the paths of cloud unit tests to prevent parallel executions from interfering with each other. This is necessary since these tests now run for all release branches and can run in parallel.

Fixes: #107137
Fixes: #107139

Release note: None

Co-authored-by: Drew Kimball <drewk@cockroachlabs.com>
Co-authored-by: Rui Hu <rui@cockroachlabs.com>
@craig craig bot closed this as completed in a370f6e Jul 21, 2023
Disaster Recovery Backlog automation moved this from Triage to Done Jul 21, 2023
THardy98 pushed a commit to THardy98/cockroach that referenced this issue Jul 24, 2023
Append a random uint64 in the paths of cloud unit tests to prevent parallel
executions from interfering with each other. This is necessary since these tests
now run for all release branches and can run in parallel.

Fixes: cockroachdb#107137
Fixes: cockroachdb#107139

Release note: None
rhu713 pushed a commit to rhu713/cockroach that referenced this issue Jul 25, 2023
Append a random uint64 in the paths of cloud unit tests to prevent parallel
executions from interfering with each other. This is necessary since these tests
now run for all release branches and can run in parallel.

Fixes: cockroachdb#107137
Fixes: cockroachdb#107139

Release note: None
rhu713 pushed a commit to rhu713/cockroach that referenced this issue Jul 25, 2023
Append a random uint64 in the paths of cloud unit tests to prevent parallel
executions from interfering with each other. This is necessary since these tests
now run for all release branches and can run in parallel.

Fixes: cockroachdb#107137
Fixes: cockroachdb#107139

Release note: None
rhu713 pushed a commit to rhu713/cockroach that referenced this issue Jul 25, 2023
Append a random uint64 in the paths of cloud unit tests to prevent parallel
executions from interfering with each other. This is necessary since these tests
now run for all release branches and can run in parallel.

Fixes: cockroachdb#107137
Fixes: cockroachdb#107139

Release note: None
rhu713 pushed a commit to rhu713/cockroach that referenced this issue Aug 18, 2023
Append a random uint64 in the paths of cloud unit tests to prevent parallel
executions from interfering with each other. This is necessary since these tests
now run for all release branches and can run in parallel.

Fixes: cockroachdb#107137
Fixes: cockroachdb#107139

Release note: None
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-master Failures on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. T-disaster-recovery
Development

Successfully merging a pull request may close this issue.

2 participants