Skip to content

Initial triage: Add sickbay.yaml for eos_multicast_base lab#73

Merged
dhalperi merged 1 commit intomainfrom
triage-eos-multicast-base
Jul 14, 2025
Merged

Initial triage: Add sickbay.yaml for eos_multicast_base lab#73
dhalperi merged 1 commit intomainfrom
triage-eos-multicast-base

Conversation

@dhalperi
Copy link
Copy Markdown
Member

Summary

Initial triage of the eos_multicast_base lab that was never tested before. This PR adds proper expected failure tracking for validation discrepancies in a multicast routing environment.

Changes

Lab Details

  • Topology: PIM SSM multicast routing with 3 Arista EOS devices (rp1, rp2, rcvr) and 2 IOS test harness devices
  • Technology: PIM SSM operation with static RPs, IGMP version 3, OSPF as underlying unicast routing
  • Failures: Main RIB route validation discrepancies affecting OSPF route classification and metrics

Test Results

Before: 3 failed, 23 passed
After: 23 passed, 3 xfailed

The lab is now properly integrated into the test suite with documented expected failures for future investigation and resolution.

Next Steps

The created GitHub issue #72 outlines investigation areas for Batfish multicast routing modeling improvements, particularly around OSPF route classification consistency and PIM SSM interaction effects.

- Created GitHub issue #72 documenting multicast routing validation failures
- Added sickbay.yaml marking 3 expected failures as xfailed
- Lab contains 3 Arista EOS devices with PIM SSM and IGMP configuration
- Failures include main RIB route validation discrepancies for OSPF routes
- Lab now runs cleanly with proper expected failure tracking

Resolves initial triage of previously untested eos_multicast_base lab.
@github-actions
Copy link
Copy Markdown

Code Coverage

Package Line Rate Health
src.lab_validation 100%
src.lab_validation.parsers 100%
src.lab_validation.parsers.a10 100%
src.lab_validation.parsers.a10.commands 48%
src.lab_validation.parsers.a10.models 83%
src.lab_validation.parsers.arista 100%
src.lab_validation.parsers.arista.commands 98%
src.lab_validation.parsers.arista.grammar 100%
src.lab_validation.parsers.arista.models 100%
src.lab_validation.parsers.checkpoint 100%
src.lab_validation.parsers.checkpoint.commands 96%
src.lab_validation.parsers.checkpoint.grammar 100%
src.lab_validation.parsers.checkpoint.models 100%
src.lab_validation.parsers.common 94%
src.lab_validation.parsers.fortios 100%
src.lab_validation.parsers.fortios.commands 95%
src.lab_validation.parsers.fortios.grammar 100%
src.lab_validation.parsers.fortios.models 100%
src.lab_validation.parsers.frr 100%
src.lab_validation.parsers.frr.commands 98%
src.lab_validation.parsers.frr.grammar 100%
src.lab_validation.parsers.frr.models 100%
src.lab_validation.parsers.ios 100%
src.lab_validation.parsers.ios.commands 95%
src.lab_validation.parsers.ios.grammar 100%
src.lab_validation.parsers.ios.models 100%
src.lab_validation.parsers.iosxr 100%
src.lab_validation.parsers.iosxr.commands 97%
src.lab_validation.parsers.iosxr.grammar 100%
src.lab_validation.parsers.iosxr.models 86%
src.lab_validation.parsers.junos 100%
src.lab_validation.parsers.junos.commands 99%
src.lab_validation.parsers.junos.grammar 99%
src.lab_validation.parsers.junos.models 98%
src.lab_validation.parsers.nxos 100%
src.lab_validation.parsers.nxos.commands 95%
src.lab_validation.parsers.nxos.grammar 100%
src.lab_validation.parsers.nxos.models 100%
src.lab_validation.parsers.panos 100%
src.lab_validation.parsers.panos.commands 86%
src.lab_validation.parsers.panos.grammar 100%
src.lab_validation.parsers.panos.models 63%
src.lab_validation.parsers.vendor_agnostic 100%
src.lab_validation.parsers.vendor_agnostic.commands 51%
src.lab_validation.parsers.vendor_agnostic.models 100%
src.lab_validation.validators 71%
src.lab_validation.validators.batfish_models 100%
src.lab_validation.validators.models 91%
src.lab_validation.validators.utils 94%
Summary 84% (3256 / 3897)

@dhalperi dhalperi merged commit 61d7762 into main Jul 14, 2025
99 of 100 checks passed
@dhalperi dhalperi deleted the triage-eos-multicast-base branch July 14, 2025 23:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant