Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

gNOI-3.3: add new subtests for configuration convergence #2830

Closed
wants to merge 1 commit into from

Conversation

kjahed
Copy link
Contributor

@kjahed kjahed commented Mar 19, 2024

Add the following subtests:
1- TestConfigurationUnchanged checks that the configuration is unchanged after switchover
2- TestConfigurationConvergence checks that a large configuration is accepted within 60 seconds after switchover

Also adds a Reporter to collect diff entries from cmp.Diff. This allows the test to examine the each diff to decide whether, for e.g., the configuration match. In this enhanced switchover test, this is used to ignore leaves that are not explicitly configured (i.e., fields with nil value) when comparing against the configuration returned from the device.

@kjahed kjahed requested review from a team as code owners March 19, 2024 16:18
@OpenConfigBot
Copy link

OpenConfigBot commented Mar 19, 2024

Pull Request Functional Test Report for #2830 / 641da8e

Virtual Devices

Device Test Test Documentation Job Raw Log
Arista cEOS status
gNOI-3.3: Supervisor Switchover
Cisco 8000E status
gNOI-3.3: Supervisor Switchover
Cisco XRd status
gNOI-3.3: Supervisor Switchover
Juniper ncPTX status
gNOI-3.3: Supervisor Switchover
Nokia SR Linux status
gNOI-3.3: Supervisor Switchover
Openconfig Lemming status
gNOI-3.3: Supervisor Switchover

Hardware Devices

Device Test Test Documentation Raw Log
Arista 7808 status
gNOI-3.3: Supervisor Switchover
Cisco 8808 status
gNOI-3.3: Supervisor Switchover
Juniper PTX10008 status
gNOI-3.3: Supervisor Switchover
Nokia 7250 IXR-10e status
gNOI-3.3: Supervisor Switchover

Help

@kjahed kjahed changed the title gNOI-3.3 gNOI-3.3: add new subtests for configuration convergence Mar 19, 2024
@coveralls
Copy link

coveralls commented Mar 19, 2024

Pull Request Test Coverage Report for Build 8820903594

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • No unchanged relevant lines lost coverage.
  • Overall coverage remained the same at 55.448%

Totals Coverage Status
Change from base Build 8820223645: 0.0%
Covered Lines: 1949
Relevant Lines: 3515

💛 - Coveralls

@LimeHat
Copy link
Contributor

LimeHat commented Apr 2, 2024

Can you please add

  • new-requirement-pr tag to the PR
  • an updated README that introduces these requirements?

Thanks,

@arvbaska1 arvbaska1 added cisco-pr new-requirement-pr The PR introduces a new test scenario/requirement. labels Apr 10, 2024
@LimeHat
Copy link
Contributor

LimeHat commented Apr 25, 2024

Thanks for the updates @kjahed

I'm wondering if these subtests belong to gNOI-3.3?

Specifically for the second case, configuration convergence, there's a separate test gNMI-1.19
https://github.com/openconfig/featureprofiles/tree/main/feature/platform/controllercard/tests/SetRequest_controll_card_switchover

cc @rszarecki @dplore @cfernanz

Copy link
Member

@dplore dplore left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The implementation should probably be moved here instead:

Comment on lines +9 to +15
* Basic Switchover
* Issue gnoi.SwitchControlProcessor to the chassis with dual supervisor,
specifying the path to choose the standby RE/SUP.
* Ensure the SwitchControlProcessorResponse has the new active supervisor as
the one specified in the request.
* Validate the standby RE/SUP becomes the active after switchover
* Validate that all connected ports are re-enabled.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Basic Switchover
* Issue gnoi.SwitchControlProcessor to the chassis with dual supervisor,
specifying the path to choose the standby RE/SUP.
* Ensure the SwitchControlProcessorResponse has the new active supervisor as
the one specified in the request.
* Validate the standby RE/SUP becomes the active after switchover
* Validate that all connected ports are re-enabled.
* gNOI-3.3.1 Basic Switchover
* Issue gnoi.SwitchControlProcessor to the chassis with dual `CONTROLLER_CARD`,
specifying the path to choose the standby RE/SUP.
* Ensure the SwitchControlProcessorResponse has the new active `CONTROLLER_CARD` as
the one specified in the request.
* Validate the standby `CONTROLLER_CARD` becomes the active after switchover
* Validate that all connected ports are re-enabled.

Comment on lines +17 to +25
* Configuration consistent after switchover
* Get the configuration before switchover.
* Perform and validate switchover using the process outlined above.
* Get configuration after switchover and validate that it matches the pre-switchover configuration.

* Configuration convergence after switchover
* Perform and validate switchover using the process outlined above.
* Push a large configuration
* Get the configuration and validate that it is accepted whithin 60 seconds.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think these steps should be moved to gNMI-1.19?

I think this portion of the test is duplicate with gnmi-1.19? The implementation should probably be moved here instead:

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ack. Will close this and open a new PR for gNMI-1.19.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cisco-pr new-requirement-pr The PR introduces a new test scenario/requirement.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants