Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DocDB][Upgrade] Not found: The object '00004025000030008000000000000000.mat_view_nc' does not exist: OBJECT_NOT_FOUND #15302

Open
def- opened this issue Dec 12, 2022 · 0 comments
Assignees
Labels
area/ysql Yugabyte SQL (YSQL) kind/bug This issue is a bug priority/medium Medium priority issue qa_automation Bugs identified via itest-system, LST, Stress automation or causing automation failures qa_itest-system Bugs identified in itest-system automation

Comments

@def-
Copy link
Contributor

def- commented Dec 12, 2022

Jira Link: DB-4456

Description

Upgrade test fails when verifying objects during upgrade, from 2.13.2.0-b135 to 2.17.1.0-b190: https://phabricator.dev.yugabyte.com/D20539

testupgrade-k8s-rf3-upgrade-2.13.2.0_135: Start
	(     0.478s) User Login : Success
	(     0.214s) Refresh YB Version : Success
	(    90.597s) Setup Provider : Success
	(     0.117s) Updating Health Check Interval to 60000 sec : Success
	(   406.585s) Create universe dfel-isd2464-764857919b-20221212-094001 : Success
	(    38.897s) Start sample workloads : Success
	(   706.095s) Creating V2 backups in S3 : Success
	(   430.220s) Verify geo-partitioned objects : Success
	(   441.842s) Executing yb-admin upgrade_ysql : Success
	(     0.000s) Executing yb-admin upgrade_ysql : >>> Integration Test Failed <<< 
Verifying during upgrade failed:
Not found: The object '00004025000030008000000000000000.mat_view_nc' does not exist: OBJECT_NOT_FOUND

	(    24.428s) Saved server log files and keys at /share/jenkins/workspace/itest-system-developer/logs/2.17.1.0_testupgrade-k8s-rf3-upgrade-2.13.2.0_135_20221212_142250 : Success
	(    95.755s) Destroy universe : Success
	(     0.270s) Check and stop workloads : Success
testupgrade-k8s-rf3-upgrade-2.13.2.0_135: End

This happened on materialized view object, so CC @fizaaluthra
Postgres logs:

I1212 14:47:58.695235 50848 thread_pool.cc:170] Starting thread pool { name: pggate_ybclient queue_limit: 10000 max_workers: 1024 }
I1212 14:47:58.696506 50848 pggate.cc:231] Reset YSQL bind address to 10.9.135.200:5432
I1212 14:47:58.696555 50848 server_base_options.cc:170] Updating master addrs to {10.9.135.200:7100},{10.9.196.122:7100},{10.9.66.143:7100}
I1212 14:47:58.696628 50848 pggate.cc:143] InitTServerSharedObject: 0, 0, 4
I1212 14:47:58.696729 50848 pg_client.cc:123] Using TServer host_port: 10.9.135.200:9100
I1212 14:47:58.698675 50848 pg_client.cc:130] S 2240: Session id acquired
I1212 14:47:59.101898 50848 ybccmds.c:482] Creating Table mv_upgrade_db2_13_2_0.public.pg_temp_16427
I1212 14:48:03.831782 51017 mem_tracker.cc:299] MemTracker: hard memory limit is 3.057787 GB
I1212 14:48:03.831863 51017 mem_tracker.cc:301] MemTracker: soft memory limit is 2.599119 GB
I1212 14:48:03.833503 51017 thread_pool.cc:170] Starting thread pool { name: pggate_ybclient queue_limit: 10000 max_workers: 1024 }
I1212 14:48:03.834447 51017 pggate.cc:231] Reset YSQL bind address to 10.9.135.200:5432
I1212 14:48:03.834497 51017 server_base_options.cc:170] Updating master addrs to {10.9.135.200:7100},{10.9.196.122:7100},{10.9.66.143:7100}
I1212 14:48:03.834565 51017 pggate.cc:143] InitTServerSharedObject: 0, 0, 4
I1212 14:48:03.834633 51017 pg_client.cc:123] Using TServer host_port: 10.9.135.200:9100
I1212 14:48:03.836745 51017 pg_client.cc:130] S 2241: Session id acquired
2022-12-12 14:48:03.852 UTC [50848] ERROR:  Not found: The object '00004025000030008000000000000000.mat_view_nc' does not exist: OBJECT_NOT_FOUND
2022-12-12 14:48:03.852 UTC [50848] STATEMENT:  select count(*) from mat_view_nc

Full logs: https://drive.google.com/file/d/1yMlq6o-KptgYK5GHTfvHyMVIn2DdZhsn/view?usp=share_link

@def- def- added area/docdb YugabyteDB core features status/awaiting-triage Issue awaiting triage qa_automation Bugs identified via itest-system, LST, Stress automation or causing automation failures labels Dec 12, 2022
@yugabyte-ci yugabyte-ci added kind/bug This issue is a bug priority/medium Medium priority issue labels Dec 12, 2022
@bmatican bmatican assigned fizaaluthra and unassigned bmatican Dec 15, 2022
@bmatican bmatican added area/ysql Yugabyte SQL (YSQL) and removed area/docdb YugabyteDB core features labels Dec 15, 2022
@yugabyte-ci yugabyte-ci removed the status/awaiting-triage Issue awaiting triage label Jan 17, 2023
@Arjun-yb Arjun-yb added the qa_itest-system Bugs identified in itest-system automation label Dec 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ysql Yugabyte SQL (YSQL) kind/bug This issue is a bug priority/medium Medium priority issue qa_automation Bugs identified via itest-system, LST, Stress automation or causing automation failures qa_itest-system Bugs identified in itest-system automation
Projects
None yet
Development

No branches or pull requests

5 participants