Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: hibernate failed #70482

Closed
cockroach-teamcity opened this issue Sep 21, 2021 · 8 comments · Fixed by #71206
Closed

roachtest: hibernate failed #70482

cockroach-teamcity opened this issue Sep 21, 2021 · 8 comments · Fixed by #71206
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

roachtest.hibernate failed with artifacts on release-21.1 @ c2cc9747352c2c1e95b4ed9f3ef3d34d2f7d1257:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-36-gc2cc974735
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity added branch-release-21.1 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Sep 21, 2021
@cockroach-teamcity cockroach-teamcity added this to the 21.1 milestone Sep 21, 2021
@cockroach-teamcity
Copy link
Member Author

roachtest.hibernate failed with artifacts on release-21.1 @ 8a84d042ae5ba3639b6e8a82adc831539b48668c:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-42-g8a84d042ae
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.hibernate failed with artifacts on release-21.1 @ bdc1360164aa2a81aedf3b8c45c43389505eeeca:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-46-gbdc1360164
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

@rafiss rafiss removed the release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. label Sep 27, 2021
@cockroach-teamcity
Copy link
Member Author

roachtest.hibernate failed with artifacts on release-21.1 @ 27054e236beb375be3ca06b824d18b0d503f3205:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-57-g27054e236b
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.hibernate failed with artifacts on release-21.1 @ 5bd1a16edef216dd764b6ac5ff2974d894e3dbbe:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-64-g5bd1a16ede
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.hibernate failed with artifacts on release-21.1 @ ac6f714445f280f7ce0f867ae54ac10ffbeaf984:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-66-gac6f714445
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.hibernate failed with artifacts on release-21.1 @ 3a28e789f6739906f0ebe333c822c22638fbeb3a:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-68-g3a28e789f6
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.hibernate failed with artifacts on release-21.1 @ 8fdaa9aeb9ee80b467ab6dc883a1659f12132694:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-70-g8fdaa9aeb9
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.hibernate failed with artifacts on release-21.1 @ 134306f075c20de755a785ada3db896efe0b1d73:

The test failed on branch=release-21.1, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/hibernate/run_1
	orm_helpers.go:228,orm_helpers.go:154,java_helpers.go:216,hibernate.go:169,hibernate.go:182,test_runner.go:733: 
		Tests run on Cockroach v21.1.9-72-g134306f075
		Tests run against hibernate 5.4.30
		412 Total Tests Run
		411 tests passed
		1 test failed
		67 tests skipped
		0 tests ignored
		0 tests passed unexpectedly
		1 test failed unexpectedly
		0 tests expected failed but skipped
		18 tests expected failed but not run
		---
		--- FAIL: org.hibernate.userguide.pc.WhereTest.testLifecycle - unknown (unexpected)
		For a full summary look at the hibernate artifacts 
		
		An updated blocklist (hibernateBlockList21_1) is available in the artifacts' hibernate log
Reproduce

To reproduce, try:

# From https://go.crdb.dev/p/roachstress, perhaps edited lightly.
caffeinate ./roachstress.sh hibernate

/cc @cockroachdb/sql-experience

This test on roachdash | Improve this report!

craig bot pushed a commit that referenced this issue Oct 6, 2021
70648: sql: move a single remote flow to the gateway in some cases r=yuzefovich a=yuzefovich

**sql: show distribution info based on actual physical plan in EXPLAIN**

Previously, the `distribution` info in `EXPLAIN` output was printed
based on the recommendation about the distribution of the plan. For
example, if the plan is determined as "should be distributed", yet
it only contains a single flow on the gateway, we would say that the
plan has "full" distribution.

This commit updates the code to print the distribution based on the
actual physical plan (in the example above it would say "local"),
regardless of the reason - whether it is the recommendation to plan
locally or the data happened to be only on the gateway.

I think it makes more sense this way since now DISTSQL diagram
consisting of a single flow on the gateway more appropriately
corresponds to "local" distribution. Additionally, this change is
motivated by the follow-up commit which will introduce changes to the
physical plan during the plan finalization, and we want to show the
correct distribution in the EXPLAIN output for that too.

Release note: None

**sql: move a single remote flow to the gateway in some cases**

This commit updates the physical planner to move a single remote flow
onto the gateway in some cases, namely when
- the flow contains a processor that might increase the cardinality of
the data flowing through it or that performs the KV work
- we estimate that the whole flow doesn't reduce the cardinality when
compared against the number of rows read by the table readers.
To be conservative, when there is no estimate, we don't apply this
change to the physical plan.

The justification behind this change is the fact that we're pinning the
whole physical planning based on the placement of table readers. If the
plan consists only of a single flow, and the flow is quite expensive,
then with high enough frequency of such flows, the node having the
lease for the ranges of the table readers becomes the hot spot (we have
seen this in practice a few months ago). In such a scenario we might now
choose to run the flow locally to distribute the load on the cluster
better (assuming that the queries are issued against all nodes with
equal frequency).

The EXPLAIN output will correctly say "distribution: local" if the flow
is moved to the gateway.

Informs: #59014.

Release note (bug fix): Some query patterns that previously could cause
a single node to become a hot spot have been fixed so that the load is
evenly distributed across the whole cluster.

71011: cli: add --max-sql-memory flag to `cockroach mt start-sql` r=knz a=jaylim-crl

Previously the `--max-sql-memory` flag wasn't available to the multi-tenancy
start-sql command, even though the feature was already there for other
`start`-related commands.

Release note (cli change): `cockroach mt start-sql` will now support the
`--max-sql-memory` flag to configure maximum SQL memory capacity to store
temporary data.

Release justification: The upcoming Serverless MVP release plans to use a
different value for `--max-sql-memory` instead of the default value of 25%
of container memory. This commit is only a flag change that will only be used
in multi-tenant scenarios, and should have no impact on dedicated customers.

71105: sql: do not collect statistics on virtual columns r=mgartner a=mgartner

PR #68312 intended to update the behavior of  `CREATE STATISTICS` to
prevent statistics collection on virtual computed columns. However, it
failed to account for multi-column statistics and for
`CREATE STATISTICS` statements that explicitly reference virtual
columns. This commit accounts for these two cases.

This prevents internal errors from occuring when the system tries to
collect statistics on `NOT NULL` virtual columns. Virtual column values
are not included in the primary index. So when the statistics
job reads the primary index to sample the virtual column, it assumes the
value is null, which violates the column's `NOT NULL` constraint. This
violation causes an error.

Fixes #71080

Release note (bug fix): A bug has been fixed which caused internal
errors when collecting statistics on tables with virtual computed
columns.

71206: cmd/roachtest: add testLifecycle to hibernateIgnoreList r=ZhouXing19 a=ZhouXing19

Resolves #70482

Add `org.hibernate.userguide.pc.WhereTest.testLifecycle`
to `hibernateIgnoreList21_1`, `hibernateIgnoreList21_2`,
 and `hibernateIgnoreList22_1`.

Release note: None
Release justification: None

71212: opt: use fragment for optstepweb with long URLs r=mgartner a=mgartner

The `optstepsweb` test command can produce very long URLs. If the URL is
longer than ~8201 characters, the GitHub Pages server hosting
`optsteps.html` responds with a 414 status code.

To make these long URLs work, this commit uses a fragment rather than a
query parameter in the URL if the compressed data that represents the
optimizer steps is over 8100 characters (the 100 characters of buffer is
meant to account for the protocol, domain, and path). A fragment is not
sent to the server by the browser, so Github Pages responds
successfully. A downside is that when anchor links are clicked to
navigate the page, the original fragment is overridden and the URL is
invalid. For this reason, we still use a query parameter when the
compressed data is small enough.

Related to #68697.

Release note: None

Co-authored-by: Yahor Yuzefovich <yahor@cockroachlabs.com>
Co-authored-by: Jay <jay@cockroachlabs.com>
Co-authored-by: Marcus Gartner <marcus@cockroachlabs.com>
Co-authored-by: Jane Xing <zhouxing@uchicago.edu>
@craig craig bot closed this as completed in ed42f47 Oct 6, 2021
SQL Sessions - Deprecated automation moved this from Test failures to Done Oct 6, 2021
blathers-crl bot pushed a commit that referenced this issue Oct 6, 2021
Resolves #70482

Add `org.hibernate.userguide.pc.WhereTest.testLifecycle`
to `hibernateIgnoreList21_1`, `hibernateIgnoreList21_2`,
 and `hibernateIgnoreList22_1`.

Release note: None
Release justification: None
ericharmeling pushed a commit to ericharmeling/cockroach that referenced this issue Oct 20, 2021
Resolves cockroachdb#70482

Add `org.hibernate.userguide.pc.WhereTest.testLifecycle`
to `hibernateIgnoreList21_1`, `hibernateIgnoreList21_2`,
 and `hibernateIgnoreList22_1`.

Release note: None
Release justification: None
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Projects
No open projects
Development

Successfully merging a pull request may close this issue.

2 participants