Skip to content

DAOS-18582 test: repro (latest)#17543

Draft
janekmi wants to merge 23 commits intomasterfrom
janekmi/DAOS-18582-repro-latest
Draft

DAOS-18582 test: repro (latest)#17543
janekmi wants to merge 23 commits intomasterfrom
janekmi/DAOS-18582-repro-latest

Conversation

@janekmi
Copy link
Contributor

@janekmi janekmi commented Feb 10, 2026

Test-tag: test_daos_cat_recov_core
Skip-unit-tests: true
Skip-func-test-vm: true
Skip-fault-injection-test: true

Steps for the author:

  • Commit message follows the guidelines.
  • Appropriate Features or Test-tag pragmas were used.
  • Appropriate Functional Test Stages were run.
  • At least two positive code reviews including at least one code owner from each category referenced in the PR.
  • Testing is complete. If necessary, forced-landing label added and a reason added in a comment.

After all prior steps are complete:

  • Gatekeeper requested (daos-gatekeeper added as a reviewer).

@NiuYawei
DAOS-18531 vos: setup ts_set in vos_obj_incarnate()
63cb471 
Replace the vos_obj_hold() call before vos_obj_incarnate() with
vos_obj_acquire() to ensure the ts_set setup is fully done within
transaction, that can make code cleaner and avoid following race:

- Updater A called vos_obj_hold(), it failed to find the OI and
  mark the obj entry in ts_set as negative.
- Updater A yield.
- Concurrent updater B created OI and setup obj->obj_df.
- Updater A resumed to call vos_obj_incarnate(), it found that
  the obj->obj_df is non-NULL so skipped OI creation.
- The ts_set for updater A is now in an inconsistent state, it's
  negative but without 'se_create_idx' set.

Signed-off-by: Niu Yawei <yawei.niu@hpe.com>
@NiuYawei
Merge remote-tracking branch 'origin/master' into niu/DAOS-18531
f80e1b7 
Allow-unstable-test: true
@NiuYawei
DAOS-18531 vos: add comment for vos_obj_hold()
fff694b 
Add comment for vos_obj_hold().

Signed-off-by: Niu Yawei <yawei.niu@hpe.com>
@NiuYawei
Merge remote-tracking branch 'origin/master' into niu/DAOS-18531
0d5c350 
Allow-unstable-test: true
@github-actions
Copy link

github-actions bot commented Feb 10, 2026

Ticket title is 'pool/verify_dtx.py:VerifyDTXMetrics.test_verify_dtx_metrics - test timeout w/ stack traces'
Status is 'In Progress'
Labels: 'ci_master_weekly,md_on_ssd,weekly_test'
https://daosio.atlassian.net/browse/DAOS-18582

@janekmi janekmi force-pushed the janekmi/DAOS-18582-repro-latest branch from b75fa97 to c013a6b Compare February 11, 2026 11:56
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 11, 2026

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/2/execution/node/791/log

@janekmi
DAOS-18582 test: repro
08a3d66 
Test-tag: test_verify_dtx_metrics
Skip-unit-tests: true
Skip-func-test-vm: true
Skip-test-el-8.6-rpms: true
Skip-fault-injection-test: true

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@janekmi janekmi force-pushed the janekmi/DAOS-18582-repro-latest branch from c013a6b to 08a3d66 Compare February 11, 2026 14:22
@janekmi
DAOS-18582 test: prune Jekinsfile + run test on both medium and large
5ad0a6c 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 11, 2026

Test stage Functional Hardware Large MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/3/execution/node/736/log

@janekmi
DAOS-18582 test: run test on both medium and large (fix)
db594dc 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@janekmi
DAOS-18582 test: run on vm as well + add Jenkins stage
a35ecd1 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/6/execution/node/225/log

@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos/job/PR-17543/7/display/redirect

@janekmi
DAOS-18582 test: reduce system_ram_reserved 64GiB -> 8GiB
8b0f8d7 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/8/execution/node/225/log

@janekmi
DAOS-18582 test: further reduce system_ram_reserved 8GiB -> 1GiB
877014f 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional Hardware Medium MD on SSD completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/9/execution/node/163/log

@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/10/execution/node/225/log

@janekmi
DAOS-18582 test: reduce number of servers and clients to 3 and 1
bc482df 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/11/execution/node/225/log

@janekmi
DAOS-18582 test: remove one engine
f281027 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/12/execution/node/225/log

@janekmi
DAOS-18582 test: engines_per_host: 2 -> 1 (fix)
2a02e40 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status FAILURE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net//job/daos-stack/job/daos/view/change-requests/job/PR-17543/13/execution/node/225/log

@janekmi
DAOS-18582 test: targets: 8 -> 4
0466472 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-17543/14/testReport/

@janekmi
DAOS-18582 test: size: 575G -> 4G
7d10195 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 12, 2026

Test stage Functional on EL 8.8 completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-17543/15/testReport/

@janekmi
DAOS-18582 test: remove unsupported object classes
524966a 
too few servers

Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 13, 2026

Test stage Functional Hardware Medium MD on SSD completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-17543/16/testReport/

@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 13, 2026

Test stage Functional Hardware Large MD on SSD completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-17543/16/testReport/

@janekmi
DAOS-18582 test: remove VM and Large Cluster
c89f273 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@janekmi
Revert "DAOS-18582 test: remove unsupported object classes"
552a73c 
This reverts commit 524966a.
@janekmi
Revert "DAOS-18582 test: size: 575G -> 4G"
d6abf68 
This reverts commit 7d10195.
@janekmi
Revert "DAOS-18582 test: targets: 8 -> 4"
c7176ba 
This reverts commit 0466472.
@janekmi
Revert "DAOS-18582 test: engines_per_host: 2 -> 1 (fix)"
d7a345f 
This reverts commit 2a02e40.
@janekmi
Revert "DAOS-18582 test: remove one engine"
d6634d2 
This reverts commit f281027.
@janekmi
DAOS-18582 test: re-run
2eb778b 
Test-tag: test_verify_dtx_metrics

Signed-off-by: Jan Michalski <jan-marian.michalski@hpe.com>
@daosbuild3
Copy link
Collaborator

daosbuild3 commented Feb 13, 2026

Test stage Functional Hardware Medium MD on SSD completed with status UNSTABLE. https://jenkins-3.daos.hpc.amslabs.hpecorp.net/job/daos-stack/job/daos//view/change-requests/job/PR-17543/17/testReport/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@janekmi @daosbuild3 @NiuYawei