Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,9 @@ This test step fragment validates that:
- the response to the query conforms to the OpenAPI specification
- the content of the response reflects the created constraint reference

## [Query Success](./create_query.md)
## [Verify query Success](./create_query.md)

Check query succeeds

## [Response Format](./create_format.md)

Check response format
## [Validate Response Format](./create_format.md)

## 🛑 Create constraint reference response content is correct check

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -6,9 +6,7 @@ This test step fragment validates that constraint references can be deleted

A query to delete a constraint reference, by its owner and when the correct OVN is provided, should succeed, otherwise the DSS is in violation of **[astm.f3548.v21.DSS0005,3](../../../../../../../requirements/astm/f3548/v21.md)**.

## [Response format](./delete_format.md)

Check response format
## [Validate response format](./delete_format.md)

## 🛑 Delete constraint reference response content is correct check

Expand Down
Original file line number Diff line number Diff line change
@@ -1,14 +1,10 @@
# Read constraint reference test step fragment

This test step fragment validates that constraint references can be read
This test step fragment validates that a known constraint references can be read, and that its content is as expected.

## [Read query succeeds](./read_query.md)
## [Verify query succeeds](./read_query.md)

Check query succeeds.

## [Read response format](./read_format.md)

Check response format
## [Validate response format](./read_format.md)

## 🛑 Get constraint reference response content is correct check

Expand Down
Original file line number Diff line number Diff line change
@@ -1,14 +1,10 @@
# Search constraint reference test step fragment

This test step fragment validates that constraint references can be searched for.
This test step fragment validates that known constraint references can be searched for, and that the returned content is as expected.

## [Search query succeeds](./search_query.md)
## [Verify search query succeeds](./search_query.md)

Check query succeeds.

## [Response format](./search_format.md)

Check response format.
## [Validate response format](./search_format.md)

## 🛑 Expected constraint reference is in search results check

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,9 @@

This test step fragment validates that constraint references can be updated.

## [Update query succeeds](./update_query.md)
## [Verify update query succeeds](./update_query.md)

Check query succeeds.

## [Response Format](./update_format.md)

Check response format
## [Validate response format](./update_format.md)

## 🛑 Mutate constraint reference response content is correct check

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,9 @@ This test step fragment validates that:
- the response to the query conforms to the OpenAPI specification
- the content of the response reflects the created operational intent reference

## [Query Success](./create_query.md)
## [Verify query Success](./create_query.md)

Check query succeeds

## [Response Format](./create_format.md)

Check response format
## [Validate response format](./create_format.md)

## 🛑 Create operational intent reference response content is correct check

Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,8 @@
# Read operational intent reference test step fragment

This test step fragment validates that operational intent references can be read
This test step fragment validates that a known operational intent references can be read, and that its content is as expected.

## [Read query succeeds](./read_query.md)

Check query succeeds.
## [Verify read query succeeds](./read_query.md)

## 🛑 Get operational intent reference response format conforms to spec check

Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,8 @@
# Search operational intent reference test step fragment

This test step fragment validates that operational intent references can be searched for
This test step fragment validates that known operational intent references can be searched for, and that their content is as expected.

## [Search query succeeds](./search_query.md)

Check query succeeds.
## [Verify search query succeeds](./search_query.md)

## 🛑 Search operational intent reference response format conforms to spec check

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,9 @@

This test step fragment validates that operational intent references can be updated.

## [Update query succeeds](./update_query.md)
## [Verify update query succeeds](./update_query.md)

Check query succeeds.

## [Response Format](./update_format.md)

Check response format
## [Validate response format](./update_format.md)

## 🛑 Mutate operational intent reference response content is correct check

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

This test step fragment validates that subscriptions can be created.

## [Query Success](./create_query.md)
## [Verify query succeeds](./create_query.md)

## 🛑 Create subscription response format conforms to spec check

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,7 @@

This test step fragment validates that subscriptions can be deleted.

## [Delete query succeeds](./delete_query.md)

Check query succeeds.
## [Verify delete query succeeds](./delete_query.md)

## 🛑 Delete subscription response format conforms to spec check

Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,8 @@
# Read subscription test step fragment

This test step fragment validates that subscriptions can be read.
This test step fragment validates that a known subscriptions can be read, and that its content is correct.

## [Read query succeeds](./read_query.md)

Check query succeeds.
## [Verify read query succeeds](./read_query.md)

## 🛑 Get subscription response format conforms to spec check

Expand Down
Original file line number Diff line number Diff line change
@@ -1,10 +1,8 @@
# Search subscription test step fragment

This test step fragment validates that subscriptions can be searched for.
This test step fragment validates that known subscriptions can be searched for, and that their content is as expected.

## [Search query succeeds](./search_query.md)

Check query succeeds.
## [Verify search query succeeds](./search_query.md)

## 🛑 Created Subscription is in search results check

Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# Update subscription test step fragment

This test step fragment validates that subscriptions can be updated.

## [Verify update query succeeds](./update_query.md)

## [Validate response format and content](./update_validation.md)

This file was deleted.

Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ This test case ensures that no entities with the known test IDs exists in the DS
This test case confirms that an OIR can be created when the correct parameters are provided,
and that it can be deleted when the proper OVN is provided.

### [Create OIR test step](./fragments/oir/crud/create_correct.md)
### [Create OIR test step](./fragments/oir/crud/create_successfully.md)

Create an OIR with allowed parameters.

Expand All @@ -45,7 +45,7 @@ Delete the OIR created in the previous step.

Ensures that a DSS will only delete OIRs when the correct OVN is presented.

### [Create OIR test step](./fragments/oir/crud/create_correct.md)
### [Create OIR test step](./fragments/oir/crud/create_successfully.md)

Create an OIR to be used in this test case.

Expand Down Expand Up @@ -75,7 +75,7 @@ Cleanup the OIR created in this test case.

Test DSS behavior when mutation requests are not providing the required OVN.

### [Create OIR test step](./fragments/oir/crud/create_correct.md)
### [Create OIR test step](./fragments/oir/crud/create_successfully.md)

Create an OIR to be used in this test case.

Expand All @@ -97,7 +97,7 @@ This step verifies that an existing OIR cannot be mutated with an incorrect OVN.
If the DSS under test allows the qualifier to mutate an existing OIR with a request that provided an incorrect OVN,
it is in violation of **[astm.f3548.v21.DSS0005,1](../../../../requirements/astm/f3548/v21.md)**

### [Attempt mutation with correct OVN test step](./fragments/oir/crud/update_correct.md)
### [Attempt mutation with correct OVN test step](./fragments/oir/crud/update_successfully.md)

Confirm that an OIR can be mutated when the correct OVN is provided.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ This test step creates multiple subscriptions with different combinations of the

All subscriptions are left on the DSS when this step ends, as they are expected to be present for the subsequent step.

#### [Create subscription](./fragments/sub/crud/create_correct.md)
#### [Create subscription](./fragments/sub/crud/create.md)

### Query Existing Subscription test step

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,21 +41,15 @@ It then goes on to mutate and delete it, each time confirming that all other DSS

### Create CR validation test step

#### [Create CR](../fragments/cr/crud/create_correct.md)
#### [CR can be created](../fragments/cr/crud/create.md)

Verify that an constraint reference can be created on the primary DSS.

#### [CR Content is correct](../fragments/cr/validate/correctness.md)

Verify that the constraint reference returned by the DSS under test is properly formatted and contains the expected content.
#### [CR content is correct](../fragments/cr/validate/correctness.md)

### Retrieve newly created CR test step

Retrieve and validate synchronization of the created constraint at every DSS provided in `dss_instances`.

#### [Get CR query](../fragments/cr/crud/read_correct.md)

Check that read query succeeds.
#### [CR can be read](../fragments/cr/crud/read_known.md)

#### 🛑 Newly created CR can be consistently retrieved from all DSS instances check

Expand All @@ -69,14 +63,11 @@ primary DSS instance, this check will fail per **[astm.f3548.v21.DSS0210,A2-7-2,

#### [CR version is correct](../fragments/cr/validate/non_mutated.md)


### Search for newly created CR test step

Search for and validate synchronization of the created constraint at every DSS provided in `dss_instances`.

#### [Search CR](../fragments/cr/crud/search_correct.md)

Check that search query succeeds and the response is well-formed.
#### [CR can be searched for](../fragments/cr/crud/search_known.md)

#### 🛑 Newly created CR can be consistently searched for from all DSS instances check

Expand All @@ -98,25 +89,17 @@ Confirm that the constraint reference that was just created is properly synchron
This test step mutates the previously created constraint reference to verify that the DSS reacts properly: notably, it checks that the constraint reference version is updated,
including for changes that are not directly visible, such as changing the constraint reference's footprint.

#### [Update CR](../fragments/cr/crud/update_correct.md)

Confirm that the constraint reference can be mutated.

#### [Validate CR](../fragments/cr/validate/correctness.md)
#### [CR can be mutated](../fragments/cr/crud/update.md)

Verify that the constraint reference returned by the DSS is properly formatted and contains the correct content.

#### [CR Versions are correct](../fragments/cr/validate/mutated.md)
#### [CR content is correct](../fragments/cr/validate/correctness.md)

Verify that the constraint reference's version fields have been updated.
#### [CR versions are correct](../fragments/cr/validate/mutated.md)

### Retrieve updated CR test step

Retrieve and validate synchronization of the updated constraint at every DSS provided in `dss_instances`.

#### [Get CR query](../fragments/cr/crud/read_correct.md)

Check that read query succeeds and the response is well-formed.
#### [CR can be read](../fragments/cr/crud/read_known.md)

#### 🛑 Updated CR can be consistently retrieved from all DSS instances check

Expand All @@ -131,15 +114,13 @@ Confirm that the constraint reference that was just updated is properly synchron

#### [CR Content is correct](../fragments/cr/validate/correctness.md)

#### [CR version is correct](../fragments/cr/validate/non_mutated.md)
#### [CR versions are correct](../fragments/cr/validate/non_mutated.md)

### Search for updated CR test step

Search for and validate synchronization of the updated constraint at every DSS provided in `dss_instances`.

#### [Search CR](../fragments/cr/crud/search_correct.md)

Check that search query succeeds and the response is well-formed.
#### [CR can be searched for](../fragments/cr/crud/search_known.md)

#### 🛑 Updated CR can be consistently searched for from all DSS instances check

Expand All @@ -154,43 +135,33 @@ Confirm that the constraint reference that was just updated is properly synchron

#### [CR content is correct](../fragments/cr/validate/correctness.md)

#### [CR version is correct](../fragments/cr/validate/non_mutated.md)
#### [CR versions are correct](../fragments/cr/validate/non_mutated.md)

### Delete CR test step

Attempt to delete the constraint reference in various ways and ensure that the DSS reacts properly.

This also checks that the constraint reference data returned by a successful deletion is correct.

#### [Delete CR](../fragments/cr/crud/delete.md)

Confirm that an constraint reference can be deleted.
#### [CR can be deleted](../fragments/cr/crud/delete_known.md)

#### [Validate CR](../fragments/cr/validate/correctness.md)

Verify that the constraint reference returned by the DSS via the deletion is properly formatted and contains the correct content.

#### [CR Versions are correct](../fragments/cr/validate/non_mutated.md)
#### [CR content is correct](../fragments/cr/validate/correctness.md)

Verify that the constraint reference's version fields are as expected.
#### [CR versions are correct](../fragments/cr/validate/non_mutated.md)

### Query deleted CR test step

Attempt to query and search for the deleted constraint reference in various ways

#### [Get CR query](../fragments/cr/crud/read_correct.md)

Check that read query succeeds.
#### [CR can be read](../fragments/cr/crud/read_known.md)

#### 🛑 Deleted CR cannot be retrieved from all DSS instances check

If a DSS returns an constraint reference that was previously successfully deleted from the primary DSS,
either one of the primary DSS or the DSS that returned the constraint reference is in violation of **[astm.f3548.v21.DSS0210,2a](../../../../../requirements/astm/f3548/v21.md)**, **[astm.f3548.v21.DSS0210,A2-7-2,3b](../../../../../requirements/astm/f3548/v21.md)**,
**[astm.f3548.v21.DSS0215](../../../../../requirements/astm/f3548/v21.md)** and **[astm.f3548.v21.DSS0020](../../../../../requirements/astm/f3548/v21.md)**.

#### [Search CR](../fragments/cr/crud/search_query.md)

Check that search query succeeds.
#### [CR can be searched for](../fragments/cr/crud/search_query.md)

#### 🛑 Deleted CR cannot be searched for from all DSS instances check

Expand Down
Loading
Loading