Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 4.8.0 - Beta 6 - API integration tests #23057

Closed
1 task done
fdalmaup opened this issue Apr 22, 2024 · 2 comments
Closed
1 task done

Release 4.8.0 - Beta 6 - API integration tests #23057

fdalmaup opened this issue Apr 22, 2024 · 2 comments

Comments

@fdalmaup
Copy link
Member

fdalmaup commented Apr 22, 2024

The following issue aims to run all API integration tests for the current release candidate, report the results, and open new issues for any encountered errors.

API integration tests information

Main release candidate issue #23005
Version 4.8.0
Release candidate # Beta 6
Tag v4.8.0-beta6
Previous API integration tests issue #22832

Test report procedure

All individual test checks must be marked as:

Pass The test ran successfully.
Xfail The test was expected to fail and it failed. It must be properly justified and reported in an issue.
Skip The test was not run. It must be properly justified and reported in an issue.
Fail The test failed. A new issue must be opened to evaluate and address the problem.

All test results must have one the following statuses:

🟢 All checks passed.
🔴 There is at least one failed check.
🟡 There is at least one expected fail or skipped test and no failures.

Any failing test must be properly addressed with a new issue, detailing the error and the possible cause. It must be included in the Fixes section of the current release candidate main issue.

Any expected fail or skipped test must have an issue justifying the reason. All auditors must validate the justification for an expected fail or skipped test.

An extended report of the test results must be attached as a zip or txt. This report can be used by the auditors to dig deeper into any possible failures and details.

Conclusions 🟡

All tests have been executed and the results can be found here.

All tests have passed and the fails have been reported or justified. I therefore conclude that this issue is finished and OK for this release candidate.

Known issues

Auditors validation

The definition of done for this one is the validation of the conclusions and the test results from all auditors.

All checks from below must be accepted in order to close this issue.

@fdalmaup
Copy link
Member Author

Test report

AITresults.zip

Test results


Test name Pass XPass Skip XFail Fail Issues Ref. Status
test_active_response_endpoints.tavern.yaml 2 0 0 0 0 🟢
test_agent_DELETE_endpoints.tavern.yaml 6 0 0 0 0 🟢
test_agent_GET_endpoints.tavern.yaml 96 0 0 0 0 🟢
test_agent_POST_endpoints.tavern.yaml 6 0 0 0 0 🟢
test_agent_PUT_endpoints.tavern.yaml 10 0 0 0 0 🟢
test_cdb_list_endpoints.tavern.yaml 5 0 0 0 0 🟢
test_cluster_endpoints.tavern.yaml 49 0 0 0 0 🟢
test_decoder_endpoints.tavern.yaml 25 0 0 0 0 🟢
test_default_endpoints.tavern.yaml 1 0 0 0 0 🟢
test_experimental_endpoints.tavern.yaml 12 0 0 0 0 🟢
test_logtest_endpoints.tavern.yaml 2 0 0 0 0 🟢
test_manager_endpoints.tavern.yaml 36 0 0 0 0 🟢
test_mitre_endpoints.tavern.yaml 7 0 0 0 0 🟢
test_overview_endpoints.tavern.yaml 1 0 0 0 0 🟢
test_rbac_black_active_response_endpoints.tavern.yaml 2 0 0 0 0 🟢
test_rbac_black_agent_endpoints.tavern.yaml 42 0 0 0 0 🟢
test_rbac_black_cdb_list_endpoints.tavern.yaml 5 0 0 0 0 🟢
test_rbac_black_cluster_endpoints.tavern.yaml 19 0 0 0 0 🟢
test_rbac_black_decoder_endpoints.tavern.yaml 6 0 0 0 0 🟢
test_rbac_black_experimental_endpoints.tavern.yaml 12 0 0 0 0 🟢
test_rbac_black_logtest_endpoints.tavern.yaml 2 0 0 0 0 🟢
test_rbac_black_manager_endpoints.tavern.yaml 0 0 0 0 16 #21748 🟡
test_rbac_black_mitre_endpoints.tavern.yaml 7 0 0 0 0 🟢
test_rbac_black_overview_endpoints.tavern.yaml 1 0 0 0 0 🟢
test_rbac_black_rootcheck_endpoints.tavern.yaml 4 0 0 0 0 🟢
test_rbac_black_rule_endpoints.tavern.yaml 8 0 0 0 0 🟢
test_rbac_black_sca_endpoints.tavern.yaml 2 0 0 0 0 🟢
test_rbac_black_security_endpoints.tavern.yaml 25 0 0 0 0 🟢
test_rbac_black_syscheck_endpoints.tavern.yaml 4 0 0 0 0 🟢
test_rbac_black_syscollector_endpoints.tavern.yaml 9 0 0 0 0 🟢
test_rbac_black_task_endpoints.tavern.yaml 1 0 0 0 0 🟢
test_rbac_black_webhook_endpoints.tavern.yaml 1 0 0 0 0 🟢
test_rbac_white_active_response_endpoints.tavern.yaml 2 0 0 0 0 🟢
test_rbac_white_agent_endpoints.tavern.yaml 42 0 0 0 0 🟢
test_rbac_white_all_endpoints.tavern.yaml 163 0 0 0 0 🟢
test_rbac_white_cdb_list_endpoints.tavern.yaml 5 0 0 0 0 🟢
test_rbac_white_cluster_endpoints.tavern.yaml 19 0 0 0 0 🟢
test_rbac_white_decoder_endpoints.tavern.yaml 6 0 0 0 0 🟢
test_rbac_white_experimental_endpoints.tavern.yaml 12 0 0 0 0 🟢
test_rbac_white_logtest_endpoints.tavern.yaml 2 0 0 0 0 🟢
test_rbac_white_manager_endpoints.tavern.yaml 16 0 0 0 0 🟢
test_rbac_white_mitre_endpoints.tavern.yaml 7 0 0 0 0 🟢
test_rbac_white_overview_endpoints.tavern.yaml 1 0 0 0 0 🟢
test_rbac_white_rootcheck_endpoints.tavern.yaml 4 0 0 0 0 🟢
test_rbac_white_rule_endpoints.tavern.yaml 8 0 0 0 0 🟢
test_rbac_white_sca_endpoints.tavern.yaml 2 0 0 0 0 🟢
test_rbac_white_security_endpoints.tavern.yaml 25 0 0 0 0 🟢
test_rbac_white_syscheck_endpoints.tavern.yaml 4 0 0 0 0 🟢
test_rbac_white_syscollector_endpoints.tavern.yaml 9 0 0 0 0 🟢
test_rbac_white_task_endpoints.tavern.yaml 1 0 0 0 0 🟢
test_rbac_white_webhook_endpoints.tavern.yaml 1 0 0 0 0 🟢
test_rootcheck_endpoints.tavern.yaml 4 0 0 0 0 🟢
test_rule_endpoints.tavern.yaml 15 0 0 0 0 🟢
test_sca_endpoints.tavern.yaml 45 0 0 0 0 🟢
test_security_DELETE_endpoints.tavern.yaml 15 0 0 0 0 🟢
test_security_GET_endpoints.tavern.yaml 11 0 0 0 0 🟢
test_security_POST_endpoints.tavern.yaml 8 0 0 0 0 🟢
test_security_PUT_endpoints.tavern.yaml 9 0 0 0 0 🟢
test_syscheck_endpoints.tavern.yaml 34 0 0 0 0 🟢
test_syscollector_endpoints.tavern.yaml 159 0 0 0 0 🟢
test_task_endpoints.tavern.yaml 2 0 0 0 0 🟢

@juliamagan
Copy link
Member

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

No branches or pull requests

2 participants